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Abstract — New achievable rate regions are derived for 
the two-user additive white Gaussian multiple-access chan- 
nel with noisy feedback. The regions exhibit the follow- 
ing two properties. Irrespective of the (finite) Gaussian 
feedback-noise variances, the regions include rate points 
that lie outside the no-feedback capacity region, and when 
the feedback-noise variances tend to the regions converge 
to the perfect-feedback capacity region. 

The new achievable regions also apply to the partial- 
feedback setting where one of the transmitters has a noisy 
feedback link and the other transmitter has no feedback 
at all. Again, irrespective of the (finite) noise variance 
on the feedback link, the regions include rate points that 
lie outside the no-feedback capacity region. Moreover, in 
the case of perfect partial feedback, i.e., where the only 
feedback link is noise-free, for certain channel parameters 
the new regions include rate points that lie outside the 
Cover-Leung region. This answers in the negative the 
question posed by van der Meulen as to whether the Cover- 
Leung region equals the capacity region of the Gaussian 
multiple-access channel with perfect partial feedback. 

Finally, we propose new achievable regions also for a 
setting where the receiver is cognizant of the realizations 
of the noise sequences on the feedback links. 



I. Introduction 

In ||5] Gaarder and Wolf showed that perfect feed- 
back from the receiver to the transmitters increases the 
capacity of some memoryless multiple-access channels 
(MACs). That this also holds for the two-user additive 
white Gaussian noise (AWGN) MAC was shown by 
Ozarow in ifTsl . where he also determined the capacity 
region of this channel with perfect feedback. Here, 
we study the capacity region of the two-user AWGN 
MAC when the feedback is imperfect. We consider the 
following settings: 

• noisy feedback where the feedback links are cor- 
rupted by AWGN; 

• noisy partial feedback where one of the two trans- 
mitters has a noisy feedback link whereas the other 
transmitter has no feedback at all; 
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• perfect partial feedback where one of the two 
transmitters has a perfect (noise-free) feedback link 
whereas the other transmitter has no feedback at all; 
and 

• noisy feedback with receiver side-information 
where both transmitters have noisy feedback links 
and the receiver (but not the transmitters) is cog- 
nizant of the feedback-noise sequences. 

The last setting arises, for example, when the receiver 
actively feeds back a quantized version of the channel 
output over perfect feedback links, and the feedback 
noises model the quantization noises, which are known 
to the receiver (The MAC with quantized feedback has 
also been considered in IT6l but under the assumption 
of a rate limitation on the feedback links and for the 
discrete memoryless case.) We show that in all these 
settings the capacity region is strictly larger than the no- 
feedback capacity region. Moreover, we show that for 
noisy feedback the capacity region tends to Ozarow's 
perfect-feedback capacity region flSl as the feedback- 
noise variances tend to zero. Finally, in the case of per- 
fect partial feedback we show that for certain channel pa- 
rameters the capacity region strictly contains the Cover- 
Leung region |4), a region that was originally derived for 
the perfect-feedback setting and that was later shown by 
Carleial [2| and (for the discrete memoryless case) by 
Willems and van der Meulen [211 to be achievable also 
in the perfect partial-feedback setting. This answers in 
the negative the question posed by van der Meulen in 
[18] as to whether the Cover-Leung region equals the 
capacity region of the AWGN MAC with perfect partial 
feedback. 

To derive these results we propose coding schemes 
for the described settings and analyze the rates that they 
achieve. The idea behind our schemes is to generalize 
Ozarow's capacity-achieving perfect-feedback scheme 
to imperfect feedback. Ozarow's scheme is based on 
the following strategy. The transmitters first map their 
messages onto message points in the interval [— i, i]. 
They then successively refine the receiver's estimates 
of these message points by sending scaled versions 
of the receiver's linear minimum mean-squared errors 
(LMMSE) of the message points. Besides achieving ca- 
pacity, Ozarow's scheme has the advantage of a double- 
exponential decay of the probability of error However, a 
drawback of the scheme is that it is extremely sensitive 
to noise on the feedback links: it does not achieve any 
positive rate if the feedback links are not noise-free [9|. 
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To overcome this weakness, we propose to apply an outer 
code around a modified version of Ozarow's scheme 
where the transmitters — ^rather than refining the message 
points — successively refine the input symbols from the 
outer code. We further modify Ozarow's scheme by 
allowing the transmitters to refine the input symbols 
by sending arbitrary linear updates (i.e., not necessarily 
LMMSE-updates) and by allowing the number of re- 
finements of each input symbol to be a constant, which 
can be optimized and which does not grow with the 
blocklength. These modifications yield a scheme which 
achieves high rates also for channels with imperfect 
feedback. In particular, for noisy feedback and for noisy 
partial feedback our scheme exhibits the following key 
properties: 

* for all finite feedback-noise variances, our scheme 
achieves rate points that lie outside the capacity 
region without feedback, and 

for noisy feedback 

* the scheme achieves rate regions that converge to 
Ozarow's perfect-feedback capacity region when 
the feedback-noise variances tend to zero. 

Previous achievable regions for the AWGN MAC 
with imperfect feedback were given by Carleial 12, by 
Willems et al. IGSiR and by Gastpar ||6J. Carleial 
and Willems et al. ||23l generalized the Cover-Leung 
coding scheme |4|. Gastpar's result is also based on 
Ozarow's scheme and on the idea of modifying it to 
use only a finite number of refinements which does not 
grow with the blocklength0 All these regions collapse 
to the no-feedback capacity region when the feedback- 
noise variances exceed a certain threshold. Moreover, as 
the feedback-noise variances tend to zero the regions in 
|I2 and [23] converge to the Cover-Leung region, which 
is a strict subset of Ozarow's region 

Kramer studied the discrete memoryless MAC with 
imperfect feedback, and presented a coding scheme for 
this setup that is based on code trees lfT2l . ifTO l. 

Outer bounds on the capacity region of the AWGN 
MAC with noisy feedback were derived by Gastpar 
and Kramer Q and Tandon and Ulukus ITtI based on 
the idea of dependence-balance |8|. These outer bounds 
do not in general coincide with any known achievable 
regions. 

The rest of the paper is outlined as follows. This 
section is concluded with remarks on notation; Section HIl 
describes the channel models in more detail; Section |III] 
discusses some previous achievability results; Section llV] 
describes our results and the new coding schemes for the 

' The result in 1,231 is for the discrete memoiyless case, but it easily 
extends to the Gaussian case. 

^The idea of using a finite number of refinements was already 
mentioned in 1151 . However, only in combination with zero rate or 
nonvanishing probability of error. 

^It can be shown that the achievable rate region in (6| converges to 
Ozarow's region when the feedback-noise variances tend to 0. 



Ml 



Trans. 1 



Ah 



Trans. 2 




Yt 



Receiver 



/Ml 



Fig. 1 . AWGN MAC with noisy feedback. 

setting with noisy feedback; Section |V] for the setting 
with noisy or perfect partial feedback; and Section [Vl] 
for the setting with noisy feedback where the receiver 
has side-information; Section WU\ finallv summarizes the 
paper. 

In the following denotes the ^-tuple {Ai, . . . , A^), 
i.e., A^ = {Al, A2, . ■ . , AiY; diag (ai, . . . , a^) denotes 
the diagonal matrix with diagonal entries ai,...,af, 
\i denotes the I x I identity matrix; denotes the 
transpose of a matrix A, |A| its determinant, and tr (A) 
its trace. Also, for zero-mean random vectors S and T 
we define the co variance matrices Ks.t — E[ST^] and 
Ks = E[SS^]. For a two-dimensional rate region TZ we 
denote by cl {TZ) its closure and by TZ its interior 

II. Channel Model 

This paper focuses on the AWGN MAC with two 
transmitters that wish to transmit messages Mi and M2 
to a single receiver. The two messages are assumed to be 
independent and uniformly distributed over the discrete 
finite sets Mi and M.2- 

To describe the channel model (see Figure [U, we 
introduce the sequence {Zt] of independent and identi- 
cally distributed (IID) zero-mean variance-A^ Gaussian 
random variables that will be used to model the addi- 
tive noise at the receiver. Using this sequence we can 
describe the time-< channel output Yt corresponding to 
the time-t channel inputs xi,t and X2.t by 

Yt = xi,t + X2,t + Zt- 

The sequence {Zt} is assumed to be indepen- 
dent of the messages (Afi,M2). Also, we introduce 
the IID sequence of bivariate zero-mean Gaussians 
{ (M^i,t7 ^2.t) } of covariance matrix 

E[Wlt] ^[Wi,tW2,t] 
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where cti,(T2 > and g E [—1,1]. The sequence 
{ {Wi,t, W2.t) } is used to model the additive noise cor- 
rapting the feedback Hnks. The time-t feedback output 
t at Transmitter can then be modeled as 



I. €{1,2}. 



The sequence {(Wi^t, VF2.t)} is assumed to be indepen- 
dent of (Mi, M2, {ZJ). 

The transmitters observe the feedback outputs in a 
causal fashion, i.e., they compute their time-t channel 
inputs Xi t and X2^t after observing all prior feedback 
outputs Vi,i, . . . , Vi,t_i and V2A, • ■ • , V2,t-i- Thus, for 
u e {1,2}, Transmitter i/ computes its channel inputs 
by mapping the Message and the previous feedback 
outputs Vi,^i, . . . ,V^^t-i into the time-i channel input 



X,,t = <^(,",'(M„K,i,...,K,t-i) 



for some sequences of encoding functions 

MuXR^-^^R, <e{l,...,n}, 



(") 



(2) 
(3) 



where n denotes the blocklength of the scheme. We 
only allow encoding functions that satisfy the power 
constraints 



1 " r 

-Y^E (^(:;)(M.,K.i,...,K.t-i) 

n ^ — ' V ' 



<P.. (4) 



where the expectation is over the messages and the 
realizations of the channel, i.e., the noise sequences 
{Zt}, {Wx,t}, and {W2An 

A blocklength-n powers-{Pi, P2) feedback-code of 
rate pair (i log(|Xi|), i log(|7W2|)) is a triple 



where 

^(«). K" ^ All X M2 

and where and |<(52"^| are of the form (O and 

satisfy (|4|i. In the following we say that a rate pair 
(i?i,i?2) is achievable if for every (5 > and every 
sufficiently large n there exists a blocklength-n powers- 
(Pi,P2) feedback code of rates exceeding Ri — S and 
R2 ~ 5 such that the average probabihty of a decoding 
error, 

Pr (yi,...,y„) ^ (Mi,M2) 

tends to as the blocklength 71 — > 00. The set of all 
achievable rate pairs for this setting is called the capacity 
region and is denoted CNoi,syFB(^'i, ^2, N, Kw-iiVa)- 

The case = (t| = corresponds to the special case 
when the feedback links are noise-free. We refer to this 

'^The achievability results in this paper remain valid also when the 
expected average block-power constraints (4) are replaced by average 
block-power constraints that hold with probability 1. 



Trans. 1 



^1. 



X2, 



Ah 



Trans. 2 




Yt 



Receiver 



[Ml 

\M2 



Fig. 2. AWGN MAC with noisy partial feedback. 
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Fig. 3. AWGN MAC with perfect partial feedback. 



setting as the "perfect-feedback" setting and denote the 
capacity region by CperfectFB(-Pi, ^^2, A^), i.e., 

CpeifectFB [Pi , ^2 , N) = CNoisyFB {Pl,P2,N, 0) 

where is the 2x2 all-zero matrix. 

In addition to the noisy-feedback setting we also con- 
sider the "partial-feedback" setting (see Figure |2]l where 
only one of the two transmitters has feedback. We as- 
sume that the transmitter with feedback is Transmitter 2. 
For the partial-feedback setting ^ and ^ are modified 
by requiring that the sequence {Xi i, . . . , Xi.„} be a 
function of Message Mi only. Since the sole feedback 
link can be noisy we shall refer to this setting also as 
"noisy partial feedback" and denote its capacity region 
by CNoisyPartiaiFB(^'i,^2,^^,CT|), wherc cr| > dcnotcs 
the noise variance on the feedback link to Transmitter 2. 
In the special case of (t| = 0, i.e., when the sole 
feedback link is noise-free, we refer to the setting as 
"perfect partial feedback" (see Figure O and denote the 
capacity region by CperfectPartiaiFB(Pi, P2, iV)- 

By the "no-feedback" setting we refer to the classical 
MAC where neither transmitter has a feedback link. 
In this case (|2|i and (O have to be modified so both 
sequences {X14, . . . , Xi^„} and {^2,1, . . . , X2,„} are 



4 



Ml 



Trans. 1 



Xi 



M2 



Trans. 2 



V2,, 




Fig. 4. AWGN MAC with noisy feedback and receiver side- 
information. 



functions of the respective messages only. We denote 
the capacity region of this MAC by CnoFb(^'i, ^2, -^)- 
Finally, we also consider a noisy-feedback setting 
where the receiver perfectly knows the realizations of the 
Gaussian noise sequences {W^i.t} and {M^2,tl corrupting 
the feedback signals (see also Figure |4|i|f| We refer 
to this setting as the "noisy feedback with receiver 
side-information" setting. For this setting the formal 
description of the communication scenario is the same 
as in the noisy-feedback setting, except for the decoder 



which is of the form 



''si 



Ml X M2, 



We denote the capacity region of the MAC with 
noisy feedback and perfect receiver side-information by 

CNoisyFBSl(-Pl, ^2, ^^1^2)- 

III. Previous Results 

We survey some previous results that are needed in 
the sequel. 

The capacity region of the classical AWGN MAC 
without feedback CnoFb(^i, ^2, ^) was independently 
determined by Cover [3J and Wyner 1251 and is given 
by the set of all rate pairs (it!i,i?2) satisfying 



i?i<ilog(l + § 



1 



i?2 < log 1 + 



P2 



i?i + i?2 < 2 ( 1 



N 
P1+P2 
N 



(5a) 
(5b) 
(5c) 



^ Since we do not consider any delay constraints and the receiver 
cannot actively feed back a signal, it does not matter whether the 
receiver learns the feedback-noise sequences {Wi,f} and {W2,t} 
causally or acausally. 



The capacity region of the AWGN MAC with per- 
fect feedback CpeifectFB(^'i, ^2, was determined by 
Ozarow |13|: 

CperfectFB(-Pl,-P2,A^) = |J 7^g, (Fl , F2 , iV) , (6) 

pe[o,i] 

where TZq^{Pi , P2 , N) is the set of all rate pairs 
(i?i,i?2) satisfying 

R 



i?2 < 2 log 



(7a) 
(7b) 



p ^ p ^ 1 1 Pi+P2 + 2^/KKp\ ,„ . 
i?i + i?2 < 2 log ( 1 + ) ■ (7c) 

We next describe some properties of the regions 

7^g,(Pl,P2,^^) and CperfectFB(Pl,P2,^) that will be 

needed in subsequent sections. Some of the properties. 
Remarks 1111.214111.41 and Remark IIII.8I were reported in 

Gl. 

Definition III.l. The parameter p*{Pi,P2,N) (for 
short p*) is defined as the unique solution in the interval 
[0, 1] of the following quartic equation in p 



N{N + P1+P2+ 2^/P^p) 

= {N + Pi{l-p^))iN + P2{l~p^)). (8) 

Remark III.2. Equation dHJ is equivalent to the right- 
hand side (RHS) of ( I7cb being equal to the sum of the 
RHSs of ^ and 

That (HJ has a unique solution in the interval [0, 1] can 
be seen as follows. At p = the left-hand side (LHS) 
of dHJ is smaller than its RHS, whereas for p — 1 the 
LHS is larger Since the expressions on both sides of 
^ are continuous, by the Intermediate Value Theorem 
there must exist at least one solution to ^ in [0, 1]. The 
uniqueness of the solution follows by noting that the 
LHS of dHJ is strictly increasing in p whereas the RHS 
is strictly decreasing in p G [0, 1]. 

Next, we discuss the region TZq^{Pi, P2, N) and ex- 
amine the rate constraints ^ defining the region. The 
RHS of single-rate constraint and the RHS of ( iTbl l 
are both strictly decreasing in p e [0,1], whereas the 
RHS of the sum-rate constraint (fTcl i is strictly increasing 
in p. By these properties, by Definition IIII.ll and by 
Remark [111.21 we have: 

Remark III.3. For p — p* the sum of the RHSs of the 
single-rate constraints (17 ab and (I7bb equals the RHS of 
the sum-rate constraint (iTcI l; for p G [0; P*) the sum of 
the RHSs of ( fTal ) and ilhi is strictly larger than the RHS 
of (I7cb ; and for p e (p* , 1] the sum of the RHSs of ( iTal l 
and dTbl l is strictly smaller than the RHS of (iTcb . 
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Remark III.4. For every p € [0,p*) the rate region 
TZqJ^Pi, P2, N) has the shape of a pentagon and for 
every p £ the rate region TZ.q^(Pi,P2,N) has 

the shape of a rectangle. Furthermore, all rectangles 
TZq^{Pi, P2, N) for p g strictly contained 

in the rectangle TZq^(Pi, P2, N), and thus in ^ it is 
enough to take the union over all p G [0, p*]. 

For the next two observations we introduce the no- 
tation of a dominant corner point as in |14|. A corner 
point of a given rate region is called dominant if it is of 
maximum sum-rate in the considered region. 

Remark III.5. To every boundary point of 
CperfectFB (^1 1 -Pj ■ N) that has sum-rate larger or 
equal to i log (l + ^^^^^ ) ^^^''^ exists a p £ [0, p*] 
such that this point is a dominant comer point of the 
region n^^{Pi,P2,N) (see Fig^S}. 

Remark IIII.5I follows by Remark IIII.4I by continuity 
considerations, and by the monotonicities of the con- 
straints (TTall-jTcli. see Remark IIII.3I To state the next 
observation we define: 

Definition 111.6. For each p e [0,/9*], we define 
TZ'^ Q^{Pi, P2, N) as the set of all rate pairs (i?i,i?2) 
satisfying 

i?i < - log 1 + — — 

2 ^ V N 



^^1 f Pi + P2 + 2VP[P^p + N 

Similarly, TZf^ q^{Pi, P2, N) as the set of all rate pairs 
(i?i,i?2) satisfying 



fPi+P2 + 2VKKp + N 
^^-2^"H P2il~P^)+N 



i?2 < ^ log ( 1 



2 ° V N 
Notice that by Remark HTlII n(o^{Pi, P2, N) = 

2,0z( 



ery p e [0,p*] the regions TZ1q^{Pi, P2, N) and 
Q^{Pi , P2 , N) are rectangles with dominant corner 
point equal to one of the dominant corner points of 
7?.Q^(Pi, P2, N), see Figure|5] By these observations and 
by Remark fill. 51 we obtain: 

Remark III.7. The perfect-feedback capacity region can 
be expressed as 

CperfectFB (-Pi , ^2 , N) 

= U (7^^_oz(^l,^2,^)U7^^oz(^l,^2,A^)).(9) 

pe[o.p'] 

The final remark follows from Remark [III. 51 and from 
the strict monotonicity in p of the RHS of the sum-rate 
constraint ( iTcl i. 

Remark III.8. The dominant corner point of the rect- 
angle TZq^{Pi, P2, N) is the only rate point of maximum 
sum-rate in CperfectFB (Pi, P2, 

We next first present an achievability result for general 
discrete memoryless MACs and AWGN MACs with 
perfect feedback due to Cover and Leung |4|. The 
scheme is known to achieve capacity for a specific class 
of discrete memoryless MACs with perfect feedback 
II20I . However, for general channels it can be suboptimal, 
e.g., for Gaussian channels. For Gaussian channels the 
optimization problem defining the Cover-Leung region 
is solved by jointly Gaussian inputs, see |fT9l , |[T1, and 
therefore the Cover-Leung region is given by 

7^cL(Pl,P2,iV)= U 4;"''=^(Pi,P2,A^), 
Pi,p2e[o,i] 

where TZ^^'''^\Pi, P2, N) comprises all rate pairs 
(Pi,P2) satisfying 



Pi < 2 log 



P2 < - los 



N 



(10a) 



P2{i-pI) 



N 



(10b) 



Pi + P2 < 2 log 



Pi + P2 + 2^I\KpiP2 
N 



(10c) 



^2,Oz(^i.^2,iV) = 7^g,(Pl,P2,A^). Also, for ev 



Carleial 111 and Willems ll2Tll independently proved that 
to achieve the Cover-Leung region TZcl{Pi , P2 , N) it 
suffices that only one of the two transmitters have a per- 
fect feedback link, i.e., they proved that the Cover-Leung 
region is achievable also in a perfect partial-feedback 
setting. Thereupon, van der Meulen in a survey paper on 
multiple -access channels with feedback |18| posed the 
question whether the Cover-Leung region equals the ca- 
pacity region for discrete memoryless MACs or AWGN 
MACs with perfect partial feedback. We will answer 
this question in the negative for Gaussian channels by 
proving that for certain channel parameters (Pi , P2 , N) 
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there exist rate pairs that He outside the Cover-Leung 
region TZcl{Pi, P2, N) but that are achievable in the 
perfect partial-feedback setting. 

For the AWGN MAC with perfect partial feedback 
Willems, van der Meulen, and Schalkwijk proposed an 
encoding scheme [22j which is based on the scheme by 
Schalkwijk and Kailath ifTSl . Unfortunately, the achiev- 
able rate region can only be stated in an implicit form 
and is difficult to evaluate analytically and to compare 
to the Cover-Leung region. 

In ||2l Carleial proposed a coding scheme for the 
discrete memoryless MAC and the AWGN MAC with 
"generalized" feedback. In the Gaussian case, "general- 
ized" feedback includes as special cases noisy feedback, 
noisy partial feedback, and perfect partial feedback. We 
present Carleial's region for the AWGN MAC with noisy 
feedback in Appendix |A] where we also prove that 
if the feedback noise variances af and (t| exceed a 
certain threshold depending on the channel parameters 
Pi,P2, and N, then Carleial's region collapses to the 
no-feedback capacity region in ^ (Proposition IA.3I 
in Appendix |A]i. For perfect partial feedback and for 
perfect feedback Carleial's scheme equals the Cover- 
Leung region TIcl{Pi , P2 , N) . Hence, in the case of per- 
fect feedback Carleial's scheme is known to be strictly 
suboptimal for the two-user AWGN MAC. 

Another coding scheme for the MAC with imperfect 
feedback was proposed by Willems et al. in 123|. Al- 
though proposed for discrete memoryless channels, the 
modifications to treat the Gaussian case are straight- 
forward, and we state their achievable rate region for 
the AWGN MAC with noisy feedback in Appendix |B] 
Like Carleial's scheme, Willems et al.'s scheme collapses 
to the no-feedback capacity region when the feedback- 
noise variances af and ct| exceed a certain threshold 
(Proposition IA.6I in Section |B]i, and for perfect feedback 
or perfect partial feedback the region equals the Cover- 
Leung region. Thus, for very noisy feedback, for perfect 
feedback, and for perfect partial feedback Carleial's 
region and Willems et al.'s region coincide. 

IV. Noisy Feedback 

In this section we focus on the setup with noisy feed- 
back. For this setup we present new achievable regions, 
and based on these new regions we derive new qualitative 
properties of the capacity region (Section flV-At . We also 
present the coding schemes corresponding to our new 
achievable regions (Sections lIV-Bl - llV^^ . 

A. Results 

In this section we present our results for noisy feed- 
back. We begin with some definitions. For given positive 
integer rj; yy-dimensional column-vectors ai,a2; and 
T] X Ty-matrices Bi, B2, we define the rj x 2 matrix 

Ar = (ai a2), (11) 



the 2?7 X 2 matrix 



ai 
a2 / ' 



the 77 X 277 matrix 



the 2r/ X 1] matrix 



Br^(Bi B2), 



B. 



Bo 



the 2?7 X 21] block-diagonal matrix 
R A /Bi 

and the 2ri x 2rj matrix 

A /Bi Bi 



Bb 



B2 B2 



(12) 



(13) 



(14) 



(15) 



(16) 



Our first achievable region for noisy feedback is 
obtained by evaluating the rates that are achieved by the 
concatenated scheme in Section ITV-C II ahead. (An alter- 
native formulation of this achievable region is presented 
in Section IdTI) 

Definition IV.l. Let rj be a positive integer, let ai,a2 
be rj- dimensional vectors, let Bi,B2 be rj x rj strictly 
lower-triangular matrices, and let C be a 2 x rj 
matrix. Depending on the matrix C the rate region 
TZ {N, W2 ; 3^1 1 3^2 , Bi , B2 , C) is defined as follows. 

• If the product CC is nonsingular^ then 
7?. (A^, ^1: ^2, Bi, B2, C) is defined 
as the set of all rate-pairs (i?i,i?2) satisfying the 
three rate constraints ( II8I 1 on top of the next page, 
where and B^ are defined in (II 11 1 and ( 1131 ) and 
where (8) denotes the Kronecker product. 

• If the product CC^ is singular but C 7^ 0, then 
TZ {N, ^WiW2 ; ^! 3-1 J £^2) Bi, B2, C) is defined as the 
set of all rate pairs (i?i,i?2) satisfying (II8I 1 when 
the 2 XT] matrix C is replaced by the rj-dimensional 
row-vector obtained by choosing one of the non- 
zero rows of cjzl 

• If Q = 0, then 7?. (iV, Kvy^vVa ! '7: ^i' ^2, Bi, B2, C) 
is defined as the set containing only the origin. 

Definition IV.2. Define the rate region 
TZ (Pi, P2, KW1W2) (or for short TZ) as 

TZiPi,P2,N,Kw,W2) 

= cl (J 7^(iV, KH/iVK2;?y,ai,a2,Bi,B2,C) 

yjj,ai,a2,Bi,B2,C 

(17) 

• Whenever r; g N is lai'ger than 1, there is no loss in optimality in 
restricting attention to matrices C so that CC^ is nonsingular. However, 
for completeness, we consider all possible choices of the matrix C. 

'when CC^ is singular then the two rows of C are linearly dependent 
and it does not matter which non-zero row is chosen. 
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1 |C (aial + N\, + B,{Kw,w. ^ \,)B]) C\ 

2r^ ^ |C (iVI, + B,{Kw,w, l,)Bn 0\ ^ ' 

'-2ry ^ |C(7VI,, + B,(K^,iv, (^l^)B;)a| 

, fi. < 1 |C (A,A^ + iVI, + B,iKw,w, ^ \M C\ , 
i?i + i?2 < ^ log 1^ ^^1^ ^ g^^^^^^^ ^ i^^g,^ (18c) 



tr 0) (b^ - Bb)-i (AdAj + TVBeB^ + Ba{Kw,w, «> l^)B5) (b^ - Bb)"' (^'jj j < r/Pi (19a) 

tr(^(0 l„)(l2^-Bb)"'(AdA;i + iVB,B; + Bd(KwiW'. ®l^)B5)(b^-Bb)"'(^°^^ < r^Pz (19b) 



where the union is over all tuples (77, ai,a2, Bi, B2,C) 
satisfying the trace constraints ( I19l l on top of the next 
page, and where the matrices Ad, Be, Bd, and Bb are 
defined in (O, (O, ([Bll, and 

Theorem IV.3 (Noisy Feedback). The capacity re- 
gion CNoisyFB (-Pi , -P2 , -/V, Kvy^ W2 ) of the two-user AWGN 
MAC with noisy feedback contains the rate region 
n{Pi,P2,N,Kw,W2), i-e., 

CNoisyFB {Pi, P21 N ,KwiW2) ^ {Pl^ P2, N ,KwiW2) ■ 

Proof: The proof is based on the concatenated 
scheme in Section II V-C 1 1 As will be described ahead, 
for each choice of parameters 77, ai, a2, Bi, B2, C our 
concatenated scheme achieves the capacity region 
of the AWGN MAC 6,6 ^ {^1,^2^ in ^ 
scaled by a factor 77"^, i.e., it achieves the region 
7?. (A^, K^jVV2; ^1, ^2, Bi, B2, C). The details of the 
proof are omitted. ■ 

Remark IV.4. Evaluating the achievable region 
TZ (Pi, P2, N, KW1W2) seems to be difficult even numer- 
ically. More easily computable (but possibly smaller) 
achievable regions are obtained by taking the union on 
the RHS of (Ull) only over a subset of the parameters 
r], ai, a2, Bi, B2, C satisfying (|19l l. In Appendices \E\ and 
\F\ we present two such subsets and their corresponding 
achievable regions ( Corollaries \A. 1 7l and \A.13\l . In Sec- 
tion \IV-C2\ we present more general guidelines on how 
to choose the parameters 77, ai, a2, Bi, B2, C. 

Proposition IV.5 (Monotonicity and Convergence of the 
region TZ). The achievable region TZ (Pi , P2, N,KwiW2) 
satisfies the following three properties: 

1) Given Pi, P2, N > 0, it is monotonically decreas- 
ing in KwiW2 with respect to the Loewner order, 
i.e., for positive semidefinite matrices KwiW2 and 

**Since Bi and B2 are strictly lower-triangular, the matrix 
(l2r( — B(,) is nonsingular and its inverse exists. 



K' 

'^WlW2- 

(niPi,P2,N,Kw,W2) 

C7^(Pl,P2,7V, K'^.v^j). 

2) Given KwiW2 ^ and N > 0, it is continuous in 
Pi and P2, i.e., for all Pi, P2 > 0." 

cl [ U 7^ (Pi - ,5, P2 - S, N, Kw,W2)] 
\s>o / 
= TZ{Pi,P2,N,Kw,W2)- 

3) Given Pi,P2,N > 0, it converges to the perfect- 
feedback achievable region TZ (Pi , P2, N, 0) ai the 
feedback-noise variances tend to irrespective of 
the feedback-noise correlations, i.e., 

cl I U n 7^(Pl,P2,iV,K) j 

= TZ{Pi,P2,N,0). (20) 

Proof: See Appendix IIV-EII ■ 
Specializing Theorem llV.3l to symmetric channels, i.e., 
to Pi = P2 = P and ai = (T2 — cr^, and to rj — 2 and 
the choice of parameters ai, a2, Bi, B2, and C presented 
in Section lEll yields the following Corollary IIV.6I 

Corollary I'V.6 (Symmetric Noisy Feedback Channel- 
s — Sub-Optimal Choice of Parameters). The capacity 
region CNoisyFB (-P, P, N, KW1W2) of the symmetric two- 
user AWGN MAC with noisy feedback, i.e., where 

fa' a'g\ 
^W,W2 - ^^2^ ^2 ) , 

contains all rate pairs (Pi,P2) satisfying the rate 
constraints |27] on top of the next page. In particular, it 
contains the equal-rate point {R, R) whenever it satisfies 
( I22I 1 on top of the next page. 
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1 / 2P\ 1 \ 
i?2 < - log 1 + — + - log 1 + -, T (21a) 

1 / 2P\ 1 / 2P^ \ 



1 / 2P\ 1 / 2P^ \ 

^ ^ i^"^- V ^ ^) + 8 + (2P + A.)(P + ^ + .^ + f.^(l-,)) ) ^^^^ 



From Corollary IIV.6I it is easily seen that the capacity 
of the symmetric noisy-feedback setup is larger than the 
no-feedback capacity, no matter how large (but finite) the 
feedback-noise variance is. The following stronger 
result holds: 

Theorem IV.7 (Noisy Feedback is Always Beneficial). 

For every feedback-noise covariance matrix KwiW2 

CnoFb(A, ^2, C CNoisyFB(-Pl, -P2, KvFilVa), 

where the inclusion is strict. 



Proof: Follows by Theorem IV. 6 1 ahead, which es- 
tablishes that noisy partial feedback always increases 
capacity, and by observing that — since Transmitter 1 can 
always ignore its feedback — noisy feedback cannot be 
worse than noisy partial feedback, i.e., for all covariance 



matrices K 



W1W2 



-( -I 



<Ti(J2Q 



\(Tia2g 0-2 



CNoisyFB {Pi, P2, NjKwiW^) 

2 CNoisyPartialFB {Pi,P2,N,ai). 



Specializing Theorem IIV.3I to perfect feedback, i.e., 
KwiiV2 = 0> ™d to the choice of parameters presented 
in Section [FT] yields the following remark. 

Remark IV.8 (Perfect Feedback). For the two-user 
AWGN MAC with perfect feedback our concatenated 
scheme achieves all rate pairs inside the region 
nC{Pi,P2,N), i.e., 

7^(Pl,P2,iv,o)^<;(Pl,P2,7V). 

Proof: Is based on the specific choice of parameters 
in Section IfTI i.e., on the regions 72.,,(Pi, P2, iV, 0) in 
Remark lATT4l For details, see Section ■ 
We next consider the noisy-feedback setting in the 
asymptotic regime where the noise variances on both 
feedback links vanish. Proposition IIV.9I ahead shows 
that our achievable regions in Theorem IIV.3I converge 
to the point of maximum sum-rate in CperfectFB when the 
feedback-noise variances tend to 0, irrespective of the 
feedback-noise correlation. 



Proposition IV.9 (Convergence to Maximum Sum-Rate 
of Cpei-fectFB)- Our achievable region satisfies 



cll U fl 7^(Pl,P2,7V,K) 

(t2>0 KtO:tr(K)<cr2 



(23) 



Thus, by Remark \III.8\ our achievable regions in Theo- 
rem \IV.3\ asymptotically approach the point of maximum 
sum-rate in the perfect-feedback capacity region. 



Proof: Follows directly by Proposition |IV.5l Part[3]l, 
and by Remark HV8] ■ 



Remark IV.IO. We can strengthen Proposition \IV.9\ 
as follows: Inclusion (1231 ) remains valid if the 
region TZ {Pi, P2, N,K) is replaced by the union 
^U,;eN^»)(^i'^2,^, K)^, where the regions 

TZri{Pi, P2, N,K) are defined in Definition IA.i21 
and represent the regions achieved by our concatenated 
scheme for the specific choice of parameters presented 
in Section If 7 1 

Our last achievability result for noisy feedback is 
based on the rate-splitting scheme in Section IIV-DII 
Before stating the result in Proposition IIV. 131 we define: 

Definition IV.ll. For fixed j] G N; fixed rj- dimensional 
vectors ai,a2; 77 x 77 strictly lower-triangular matri- 
ces 61,62; and 2x1] matrix C define the region 
72.RS,i (-Pi'i^;Kh/jH'2;'77 ai,a2, 61,62, C) as the set of 
all rate pairs (i?i,i?2) that for some nonnegative 
^i.cSi^i.NF summing to Ri satisfy the following two 
conditions: 

(i?i,cs, i?2) en{N + Pi Kw^W2;V, ai, aa, 61, 62, C) 
and 

1 f \P[h, + Nl, + B,{Kw,W2(^K)B]\ 

Ki,NF _ 2^ log 1^ 1^1^ ^ B,{Kw,W2 ® \M 

(24) 

where 6, is defined in il3i . 

Similarly, define the region 

'7?.RS,2 (^'2, ^, ^WiW2',V, ai, a2, Bi, 62, C) analogously 
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to the region 7^Rs,l {P[,N, Kvy^vKs ; J?, a2, Bi, B2,C), 
but with exchanged indices 1 and 2. 

Definition IV.12. Define the rate region 
nRs,iiPi,Pi,P2,N,Kw^w,) (or for short 7^Rs,lj 
as 



nRs,i{P[,Pl',P2,N,Kw,w,) 

= cl( |J7^Rs,l {P[,N, KM/iW2;??,ai,a2, Bi, B2,C) 



and Ki 



K 



WlW2- 



>- K' 



where the union is over all tuples (ry, ai,a2; Bi, B2,C) 
satisfying the trace constraints ( 1191 ) for powers P[' 
and P2, noise variance (N + Pi), and feedback-noise 
covariance matrix KwiW2- Similarly, define the region 
'R'RS,2 {Pi,P2,P2, N, KvviWs) (or for short 7?.Rs,2j as 



7^RS,2 {Pi,P^,Pi\N,Kw,W2) 

= elf |J7^Rs,2 iP2,N, KM/iW2;?7,ai,a2, Bi, B2,C) 



where the union is over all tuples (77, ai,a2, Bi, B2,C) 
satisfying the trace constraints ( 1191 ) for powers Pi and 
P2, noise variance [N + P2), and feedback-noise co- 
variance matrix KwiW2- 

Proposition IV.13 (Rate-Splitting for Noisy Feedback). 

The capacity region CNoisyFB(^'i, ^'2, A^, KvKiWa) con- 
tains the region TZrs.i (Pi, (Pi — P{),P2,N, KW1W2) 
for any P[ G [0, Pi], and it contains the region 
7^RS.2 (Pi ,P^AP2-P2), N, Kw,W2) for any P^ € 
[0,P2]: 

CNoisyFB (-Pi , P2, N,KwiW2) 

2 U 7^Rs,l (Pi', (Pi - Pi'), P2,N, Kw,W2) 



and 



CNoisyFB (Pi iP2,N,KwiW2) 

2 U n^5a{Pl,P2,{P2-P2).N,Kw,W2)- 
P^G[0,P2] 

Proof: The rate region is achieved by the rate- 
spUtting scheme in Section HV-D II The analysis is based 
on Theorem I1V.3I on the capacity of a Gaussian multi- 
input antenna/multi-output antenna channel with noise 
sequences that are temporally-white but correlated across 
the antennas, and on a genie-aided argument as in fT4l 
and II24I p. 419]. The details are omitted. ■ 

Proposition IV.14 (Monotonicity and Convergence of 
Regions 7?.rs,i and 7?.rs,2)- The achievable region 
'Ti-R5A(Pi,Pi ,N,y\WiW2) satisfies the following three 
properties: 

1) Given P{, P" , P2, N > 0, it is monotonically de- 
creasing in K\YiW2 with respect to the Loewner or- 
der, i.e., for positive semidefinite matrices KwiW2 



W1W2 •^WiW2^ 

7^Rs,l(Pl',P^^2,^f, KpviM/J 



2) Given K\YiW2 ^ and N > 0, it is continuous in 
P{, P{', and P2, i.e., for all P{,P{', P2 > 0: 



cl(U7^ 

\5>0 



RS,i iP[ - S, Pi" - 5, P2 - <5, N, Kw,W2 )j 

= nRS,l(Pi,Pl,P2:N,Kw,W2)- 

3) Given P{,P{',P2,N > 0, it converges 
to the perfect-feedback achievable region 
T^RS,i {Pi 1 Pi' T P2t N,Q) as the feedback-noise 
variances tend to irrespective of the feedback- 
noise correlations, i.e., 

ci I u n 7^Rs.l(p^,pr,P2,A^,K) 
=7^Rs,l(p^,A'^^2,A^,o). 

Similarly for TZrs,2 (Pi, P2, P2', N, KwiW'a)- 



Proof: Follows from Proposition IIV.5I and because 
for fixed ai,a2, Bi, B2, and C the RHS of ( l24l i satisfies 
the following three properties. It is monotonically de- 
creasing in KwiW2 with respect to the Loewner order, it 
is continuous in P{, and it converges to i log (^1 + 
as the feedback-noise variances tend to irrespective of 
the feedback-noise correlations. The details are omitted. 



With the rate-splitting extension in Section IIV-DII 
and Propositions HyTJ] and II V. 141 Remark \NI\ and 
Proposition I1V.9I can be generalized to all the boundary 
points of the capacity region CperfectFB- 

Remark IV.15 (Perfect Feedback). For the two- 
user AWGN MAC with perfect feedback our rate- 
splitting scheme in Section \IV-D1\ achieves all rate 
pairs in Ozarow's perfect-feedback capacity region 

CperfectFB (Pl,P2,N): 
CperfectFB (Pi , P2 , N) 

U 7^Rs,l(Pl',(Pl-Pl'),P2,iv,o) 

U U 7^Rs,2(Pl,P^,(P2-P^),A^,0) 

\f2 6[0,-P2] 

(25) 

In fact, for each p € [0, p*] there exists a Pi(p) G [0, Pi] 
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(26a) 



so that 

Uks.i {P[{p), {Pi ~P[ip)),P2,N,0) 
and a Pl^ip) G [0,-P2] ■so that 

7^RS,2 (Pl,P^(p),(P2-P^(p)),iV,0) 

D7^^0z(^l>^2,^). (26b) 

Proof: By Remark IIII.7I Equality (l25T l follows di- 
rectly from (|26] |. For a proof of (|26] |. see Section IIV-E3I 



Proposition IV.16 (Convergence to Boundary of 

CperfectFB)- For every p G [0, p* (Fi, F2, ^)] we can find 
some P[{p) G [0, Pi] so that 



I 



cl 



\ 

U n 7^Rs,l(A'(p),(A-P^(p)),P2,iV,K) 

/ 

(27a) 



^>0 K^O: 
tr(K)<CT 
•>P 



D7^?o,(Pl,P2,A^). 

Similarly, for every p S [0, /9*(Pi, P2, -^)] we can find 
some P2ip) € [0,^2] so that 



( 



cl 



U n 7^Rs,2(Pl,P^(p),(P2-P^(p)),iV,K) 

tr(K)<o-^ / 

3^2,Oz(-Pi>-P2,A^). (27b) 

Thus, by Remark \in.5\ and Definition \in.6\ our achievable 
regions in Proposition \IV.13\ asymptotically approach all 
boundary points of the perfect-feedback capacity region. 



Proof See Section IIV-E4l ■ 
Propositions IIV.13I and II V. 161 combined with Re- 
mark nil. 7 1 yield the following continuity result. 

Theorem IV.17 (Continuity of Noisy-Feedback Capacity 
Region). For all Pi,P2,N > 0: 

cl I U fl CNoisyFB(Pl,P2,iV,K) 

\cr2>0 K^0:tl-(K)<(T2 

— CperfectFB {Pi, P2, N). 

Proof See Section IIV-E5I for details. ■ 

B. Simple Scheme 

We present a simple coding scheme for the noisy- 
feedback setting. It is a special case of the concatenated 
scheme in Section IIV-CII ahead: the simple scheme with 
parameters ai^i, ai,2, a2,i; ^^2,2, ^1, &2 coincides with the 
concatenated scheme for noisy feedback with parame- 
ters T] = 2,ai = (ai,i 02,1) ,a2 = (02,1 02,2) , 

Bi= (0 '1b2=(1 0),C.l2. We present 



the simple scheme here separately, because it is easier 
and yet powerful enough to establish Corollary IIV.6I and 
Theorem HVTl 

Prior to communication a blocklength-n, rate-i?i 
codebook Ci and a blocklength-71, rate-i?2 codebook 
C2 are generated and revealed to both transmitters 
and to the receiver. The codewords of codebook 
Cl are chosen independently with the n components 
Si,i(mi), . . . , Si.„(mi) of the mi-th codeword chosen 
IID zero-mean unit-variance Gaussian. The codebook C2 
is drawn similarly. Messages Mi and M2 are then trans- 
mitted over 2?! channel uses by sending each symbol of 
the n-length codewords S"(Afi) and S2 (Af2) over two 
consecutive channel uses. More precisely, at odd time 
steps t = 2(fc — 1) + 1, for k E {!,..., n}. Transmitter 1 
sends 



Xl.2(k-1) + 1 — aia'^i.fcj 
and Transmitter 2 sends 



X. 



2,2(fe-l) + l — a2,l"2,fe- 



(28) 



(29) 



At even time steps t = 2k, for k g {!,..., n}. 
Transmitter 1 sends 

-^^1,2*; — ai,22l,fc — ^lV^l,2(fc-l) + li (30) 

and Transmitter 2 sends 

X2.2k — 0'2,2^2,k " ^2^2,2(fe-l) + l • (31) 

To ensure that the two input sequences {Xi^t}t=i and 
{X2.t}t=i satisfy the power constraints (HJl, the param- 
eters fli 1, ai 2, 02,1, a2_2j &1j and 62 are chosen as to 
simultaneously satisfy 

ali + (ai,2-feiai,i)^ + ^i(a2,i+^ + '^i) < 2Pi (32a) 
and 

ali + i<^2,2-b2a2,i)^+bliali + N+a'l) < 2P2. (32b) 

The receiver uses an optimal decoding rule to decode 
Messages Mi and M2 based on the observed sequence 
of channel outputs Yi, . . . , ¥2,1- 

To describe the performance of the scheme, let 
Si, S2, ^odd, and Zeven be independent zero-mean Gaus- 
sian random variables, where Si and S2 are of variance 1 
and Zodd and Zgven of variance TV. Independent thereof, 
let the pair {Wi, W2) be a zero-mean bivariate Gaussian 
of covariance matrix KwiW2 as defined in ([T]i- Also, let 
Yodd and yeven be defined as 

Yodd — aij'^l + 024.^2 + ^odd, 

Yeven — ai,2'^l + a2,2'^2 ^ ^l^l.odd ~ &2V2,odd + ^even; 

and Vi odd and V2,odd be defined as 

K,odd = i"odd + W^., t^e{i,2}. 
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The performance of the simple scheme is then described 
as follows. The scheme achieves all nonnegative rate 
pairs (i?i,i?2) that simultaneously satisfy 

i?i < i/(Si;yodd,l^eve„|S2), (33a) 

i?2 < ^/(S2;rodd,l^even|Si), (33b) 
Rl+R2< ^/(Si,S2;yodd,>;ven), (33c) 

or equivalently — as obtained by evaluating the mutual in- 
formation expressions on the RHSs of (l33T l — it achieves 
all nonnegative rate pairs (i?i,i?2) that simultaneously 
satisfy 



1 



+ 



'•1,2 



i?2 < - loa- 1 



+ 



bjaf + hlal + 2hih2Qcria2 + N 



N 



bltrf + hlal + 2hib2Qcricr2 + N 



and 

Rl + i?2 

<ilog fi+<l±<i 
-4^1 N 



'1,2 ~r U2,2 



hlal + 6|a| + 2hih2Q(Tia2 + N 

(ai,iQ2,2 - a2,iai,2)^ \ 

N{hlal + hlal + 2bih2Qcria2 + N) J 

for some choice of the parameters 
ai,i,ai,2,a2,i,a2,2,&i,&2 satisfying ( [32] l. 

C. Concatenated Scheme 

We first present our concatenated coding scheme with 
general parameters in Section IIV-CII in Section IIV-C2I 
we then give guidelines on how to choose the parameters 
of this concatenated scheme. 

1) Scheme: We propose an encoding scheme with 
a concatenated structure where each of the encoders 
and the decoder consists of an outer part and an inner 
part. (Here the inner parts are the parts that are closer 
to the physical channel, see Figure |6l) In our scheme 
the various parts fulfill the following tasks. The outer 
encoders map the messages into codewords (without 
using the feedback) and feed these codewords to their 
corresponding inner encoders. The inner encoders pro- 
duce for every fed symbol a sequence of rj channel inputs 
to the MAC with feedback, for some positive integer 
r/. In particular, when fed the symbol € M, Inner 



Encoder 1 produces 77 inputs which depend on ^1 and 
on the observed feedback outputs; all symbols fed to 
the inner encoder are treated in the same way. Inner 
Encoder 2 is analogously defined. The r] symbols which 
the MAC outputs for every pair of input symbols (^1 , ^2) 
are then linearly mapped by the inner decoder to a pair of 
estimates (2i, 22), and the estimates are fed to the outer 
decoder Thus, the outer decoder is fed with a vector 
in every rj channel uses. Based on the sequence of 
vectors produced by the inner decoder, the outer decoder 
then decodes the transmitted messages. 

Consequently, the inner encoders and the inner de- 
coder transform each subblock of 77 channel uses of 
the original MAC into a single channel use of a "new" 
time-invariant and memoryless MAC which for given 
inputs ^1 e M and ^2 G K produces the channel 
output (5 1,52)^ e M?. We denote the new MAC by 
Cii?2 ^ (2i,52). We can then think of the overall 
scheme as a no-feedback scheme over the new MAC 
£,ii£,2 (2i,S2). As a consequence, the capacity of 
the original MAC with feedback, which we denote by 
xitX2 I— > Y, is inner bounded by the capacity of the new 
MAC $1, ^2 ^ (Si, S2) without feedback but scaled by 
rj^"^ to account for the fact that to send the symbols 
^1, "^2 over the new MAC the original channel is used 77 
times. 

We first sketch some of the properties of the inner 
encoders and the inner decoder and postpone their de- 
tailed description to after the description of the outer 
encoders and decoder. We choose the inner encoders and 
the inner decoder so that the MAC Ci ; ^2 ^ (2i , S2) can 
be described by 



" '6 



T, 



(34) 



where A is a deterministic 2x2 matrix and where T 
is a bivariate Gaussian whose law does not depend on 
the pair of inputs (^1,^2)- Also, the inner encoders are 
designed so that if both outer encoders satisfy a unit 
average block-power constraint (over time and messages) 
and if at every epoch the symbols produced by the 
outer encoders are zero-mean (when averaged over the 
messages), then the channel inputs to the original MAC 
xi,X2 I— > y satisfy the average power constraints 

For the outer code (encoders and decoder) we choose 
a capacity achieving zero-mean code for the MAC 
Cii^2 ^ (Si,S2) under an average block-power con- 
straint of 1. Note that there is no loss in optimality 
in restricting ourselves to zero-mean codes because 
subtracting the mean of the code can only reduce its 
average power (averaged over time and messages) and 
does not change the performance on an additive noise 
MAC such as ( |34] |. We shall need the property that the 
outer encoders produce zero-mean symbols in the power- 
analysis of the input sequences to the original channel 

Xi,X2 Y. 
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Outer Enc. 1 


1 


Inner End 


1 



Ah 



Vi,t 



Outer Enc. 2 


1 


Inner Enc. 2 


1 





V2,t 



' "new" MAC 
I 

Fig. 6. Structure of concatenated scheme. 




Yt 



Inner Dec. 



r 



W2,, 



Outer Dec. 



(Ml 
\M2 



For the inner encoders and the inner decoder we 
choose linear mappings. To obtain a compact description 
of the Hnear mappings we stack the 77 channel inputs, 
1, . . . , Xy,,,, produced by Inner Encoder ly in an 77- 
dimensional column vector 



— {X,^, i, . . . , Xi, 



i'e{i,2}, 



and similarly we stack the 77 feedback outputs, 
1, . . . , Viy.r,, observed by Inner Encoder 1/ in the 77- 
dimensional vector 

We can then describe our choice of the inner encoders 
as follows. When fed the input symbol £^1, £ R, Inner 
Encoder v produces 



(35) 



where are //-dimensional column vectors and 6,^ 
are rj x r] matrices which are strictly lower-triangular 
(because the feedback is causal). Also, as previously 
mentioned, we restrict the inner encoders to produce 
sequences of inputs to the original MAC xi,X2 1— > Y 
that satisfy the average block-power constraints ^ when 
the outer encoders feed them with zero-mean sequences 
of unit average block-power By ( l35T l this is the case 
whenever the trace constraints (fT9] l are satisfied. Thus, in 
the following we only allow for vectors ai and a2 and for 
strictly lower-triangular matrices Bi and 82 satisfying 

(US). 

To describe our linear choice of the inner de- 
coder, we stack the 77 outputs which 
the original MAC produces for the pairs of inputs 
(Xi i, X2,i), . . . , (Xi into the //-dimensional 
column vector 



We can then express the estimates produced by the outer 
decoder by 



DY, 



(36) 



for some matrix of our choice D e M?^^. 

In the following we describe the MAC £,1,^2 '-^ 
(Si,S2) as induced by 77,ai,a2, 81,82, and D. Given 
inputs ^i,'^2 G it produces the vector of estimates 



(37) 



where the 2 x 2-matrix A is given by 

A-D(l^-(8i + 82))"'Ar, (38) 

where A, is defined in (fTTl i. and where the noise vector 
T is a zero-mean bivariate Gaussian 

T - D(l^ - (Bi + B2))-i(8iWi + 82 W2 + Z), (39) 

for Wi ^ {Wi.u...,Wi,^y, W2 ^ 
(W^2a,...,M^2,r,)\ and Z ^ (Notice, 
that since Bi and 82 are strictly lower-triangular 
matrices, the matrix (1^ — (81 + 82)) is nonsingular 
and the inverse exists.) Defining the 2x7/ matrix 

C^D(I, -(81 + 82))-!, (40) 

we can express the matrix A in ( l38l l as 

A = CA,, (41) 

and the noise vector in ( [39l ) can be expressed as 

T C (81W1 + 82 W2 + Z) . (42) 

For fixed 77,81,82, the mapping ( l40l l from D to C 
is one-to-one, and thus we can parameterize our con- 
catenated scheme for noisy feedback by the parameters 
7/,ai,a2, 81, 82, C. 

Note that by choosing rj = 1, ai = a/PTi 0,2 — y/^, 
and C as the 2x1 matrix with unit entries, our scheme 
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reduces to the capacity-achieving scheme for the original 
MAC xi,X2 >—?' Y without feedback subject to the power 
constraints (|4|. 

2) Choice of Parameters: Given channel param- 
eters Pi, P2, N,KwiW2^ determining for each rate 
pair in TZ {Pi , P2 , N , KW1W2) ^ set of parameters 
77, ai, a2, Bi, B2, C that achieves this rate pair seems to 
be analytically intractable. Instead, we present guidelines 
on how to choose parameters and discuss the two choices 
of parameters in Sections IE II and [FT] that lead to Corol- 
lary |IV6] and Proposition IIV.8I 

For the purpose of describing our guidelines, through- 
out this section, we replace the symbols ^1 and ^2 
fed to the inner encoders by the independent standard 
Gaussians Si and S2. 

We start with the matrix C. Given parameters 
ry, ai,a2,Bi, and B2, the matrix C should be chosen 
as C = Clmmse, where 

Clmmse - a; (a^a; + ivi„ + b,{Kw,w2 KW^r^ ■ 

(43) 

By (O, (STJ, and ( l42b this choice implies that 



[(1) 


Yi, . . . ,Yrj 







and hence we call the matrix Clmmse the LMMSE- 
estimation matrix. The choice C = Clmmse is 
optimal in the sense that the corresponding re- 
gion 7^(iV, Kn'iM/a; '7: ai:a2,Bi,B2, Clmmse) contains 
all regions 7?. (TV, KvyjVK2 ; ^1 ^i, a2, Bi, B2, C) that cor- 
respond to other choices of C. The optimality of the 
LMMSE-estimation matrix can be argued as follows. 
When ( |44] | holds, then even additionally revealing Y (or 
any linear combinations thereof) to the outer decoder 
does not increase the set of achievable rates in our 
scheme. Obviously, choosing C = UClmmse for any non- 
singular 2-by-2 matrix U is also optimal. In particular, 
when rj — 2 every non-singular matrix is an optimal 
choice for C. 

We next consider the choice of parameters 
ai,a2, 61,62 and first focus on the special case 
of perfect feedback. This special case is in view of 
Ozarow's capacity result |fT3l only of limited interest, but 
it provides insight on how to choose the parameters for 
other settings, e.g., the perfect partial-feedback setting 
(see Section IV-C2I ) and the noisy feedback-setting with 
receiver side-information (Section [VI-B2| i. 

For perfect feedback and a fixed 77, the parameters 
ai,a2,6i,62 should be chosen such that Inner En- 
coder V, for V e {1,2}, produces as its ^-th channel 
input a scaled version of the LMMSE-estimation error 
of Si, when observing (Yi, . . . , Y^^i), i.e., 

Xi., = 7ri.,(Si-E[Si|r^-i]), £e {!,..., ry}, 

(45a) 



and 

X2,i = n2,t (S2 - E [S2|r^^i] ) , £ e {1, . . . , 77}, 

(45b) 

for some real numbers tti 1, . . . , tti and 7r2,i, . . . , T^2,r)- 
In fact, every choice of parameters not satisfying ( |43]) 
can be strictly improved (with an appropriate choice of 
C) so as to achieve a larger region, see Appendix |C] 

For general noisy feedback, it is not optimal to 
choose ai,a2, 61, 62 as in (|45] | when the channel out- 
puts Yi, . . . , Yi-i are replaced by the feedback outputs 
Vi,i, . . . , Vi,^_i and V2,i, . . . , V2/-1. Intuitively, the 
reason is that with such a choice the inner encoders 
introduce too much feedback noise into the forward 
communication. 

For the general setup it seems infeasible to derive the 
set of optimal parameters ai, a2, Bi, 62. However, it is 
easily proved that the parameters ai,a2, 61, 62 have to 
be chosen so that they satisfy both power constraints 
( |19a| ) and ( |19b| i with equality, since otherwise there ex- 
ists a choice of parameters which corresponds to a larger 
achievable region. This readily follows from the alter- 
native formulation of TZ {N, \^WiW2 ; J?; ^ii ^2, Bi, 62, C) 
in Section |dT1 because the RHSs of (I148I I (which de- 
termine TZ{N, Ki4/^vy2; 77, ai, a2, Bi, B2, C)) can always 
be increased by changing the last entry of ai, i.e., ai 
or the last entry of a2, i.e., a2.T,. 

We finally consider the choice of 77. If the goal is 
to maximize the single rates, it is trivially optimal to 
choose 77 = 1 irrespective of the channel parameters 
Pi,P2,N, KwiW2- If in contrast the goal is to maximize 
the sum-rate it seems infeasible to derive the optimal 77. 
However, numerical results indicate that the larger the 
feedback-noise variances are, the smaller the parameter 
77 should be chosen. It is easily proved that in the extreme 
case of no feedback the sum-rate is maximized by choos- 
ing 77 = 1. In contrast, in the extreme case of perfect 
feedback we prove in Section ITV-E2 1 that with the choice 
of parameters suggested in Section [FT] the maximum 
sum-rate of our concatenated scheme converges to the 
perfect-feedback sum-rate capacity as the parameter 77 
tends to infinity. 

In the remaining, we discuss the two specific choices 
of the parameters ai, a2, Bi, B2, C given 77 G N pre- 
sented in Sections lEll and [FT] For both choices, the 
parameter C is the LMMSE-estimation matrix and the 
parameters ai, a2, Bi, B2 are such that when specialized 
to perfect feedback they satisfy ( l45b . In the choice in 
Section IeTI each inner encoder allocates the same power 
for all channel inputs. The achievable region correspond- 
ing to this choice is presented in Corollary lA.l 11 and 
includes as special case the result on the symmetric setup 
in Corollarv lIV.6l In the choice in Section IFTl the inner 
encoders use the power-allocation strategy suggested by 
ifTTl for perfect feedback. The corresponding achievable 
region is presented in Corollary IA.13I and includes as 
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special case the achievable region for perfect feedback 
in Remark IA.14I used in the proof of Propositions IIV.9I 
and irvl6l and Theorem HVTTl 

D. Extensions of the Concatenated Scheme 

In the following three subsections we present three 
extensions of our concatenated scheme by rate-splitting 
it with other schemes. The idea of rate-splitting was 
introduced in [S] and llT3l . 

1) Rate- Splitting with No-Feedback Scheme: In this 
first extension we combine our scheme with a no- 
feedback scheme employing IID Gaussian codewords. 
This extension was inspired by the rate-splitting scheme 
proposed by Ozarow for perfect feedback 1 13|. Only one 
transmitter applies the rate-splitting. For the description 
we assume it is Transmitter 1 . Thus, Transmitter 1 splits 
Message Mi of rate i?i into two independent parts: 
Message Mi^nf of rate i?i_NF and Message Mi_cs of 
rate Ri^cs, where i?i_NF and i?i^cs sum up to Ri. 
Here, NF stands for "no-feedback" and CS stands for 
"concatenated scheme". 

We first present a rough overview of the scheme. We 
start with the encodings. Transmitter 1 uses a fraction 
of its available power P[, for some < P{ < Pi, to 
produce a sequence by encoding Message A/i,nf using 
Gaussian codeword^ (without using the feedback). With 
the rest of the power {Pi—P{) it produces a sequence of 
the same length by encoding Message Mi_cs using our 
concatenated scheme and the outputs of the feedback 
link. It sends the sum of the two produced sequences 
over the channel. If the concatenated scheme is of 
parameter rj and its outer code is of blocklength n, then 
both sequences are of length rjn. Transmitter 2 produces 
a sequence of equal length by encoding Message M2 
with power P2 using the concatenated scheme and sends 
this sequence. 

We next present a rough overview of the decod- 
ing at the receiver. The receiver first decodes the pair 
{Mi^cs, M2) by using the inner and the outer decoder 
of our concatenated scheme and treating the transmission 
of Message Afi nf as additional noise. From its guess of 
(Afi NF, M2) the receiver cannot recover the sequences 
produced by our concatenated scheme because it is 
incognizant of the feedback noise. Nevertheless, it can 
form an estimate of both produced sequences (pretending 
that its guess of (Mi.cs, M2) is correct) and subtract the 
sum of the estimates from the received signal. Based 
on the resulting difference the receiver finally decodes 
message Afi nf, which concludes the decoding. 

In the following we describe the scheme in more 
detail. Given Afi ^jF = m-i,NF, Transmitter 1 picks the 
codeword u(toi nf) — {ui, ■ ■ ■ ,Mr)n)^ corresponding to 

'To satisfy the powers constraints tlie Gaussian codewords should 
be of variance slightly less than P^. However, this is a technicality 
which we ignore. 



mi.NF from its Gaussian codebook. Given Afi cs = 
"^i.cs. Transmitter 1 feeds mi.cs to Outer Encoder 1, 
which picks the codeword ^i(mi_cs) = (^1.1, ■ ■ • 
corresponding to mi cs from its codebook and feeds 
it to Inner Encoder 1. Similarly, given M2 ~ m2, 
Transmitter 2 feeds 1112 to Outer Encoder 2, which picks 
the codeword ^2("^2) ~ {£,2,1, ■ ■ ■ ,£,2.ny corresponding 
to 7712 and feeds it to Inner Encoder 2. Denoting the 
parameters of the inner encoders by ai,a2, Bi, and B2, 
respectively. Inner Encoder 1 forms the 7y-dimensional 
vectors 

ai6,fc + BiVi,fc, fee {!,..., n}, (46) 
and Inner Encoder 2 forms the 77-dimensional vectors 

a26,fc + B2V2,fc, /ce {!,..., n}, (47) 
where for i/ E {1, 2}: 

^u,k — (V,^,(fe_l)^+l, . . . , Viy^kriY ■ 

The signal transmitted by Transmitter 1 is the sum of 
the vectors in ( |46] l and the vectors 

Ufc = iu(k-i)7j+ii ■ ■ -^UknY, k e {I, . . . ,n}, 
i.e., 

Xi,fc = Ufe + ai^i.fc + BiVi.fe, k e {1, . . . ,n}, 

(48) 

where 

^l,k — (-'^l,(fe-l)j)+l, • • • ,Xl,kr)y, k £{!,... ,n}. 

The signal transmitted by Transmitter 2 is described by 
the vectors in ( |47] l as follows: 

X2,fe =a26,fe + B2V2,fc, fce{l,...,n}, (49) 

where 

X2,fe ^ {X2 

Notice that if ai,a2,Bi,B2 satisfy ( fT9] l for powers 
(Pi— Pi') and P2, noise variance {N+P[) and feedback- 
noise covariance matrix KwiW^ and if the outer code's 
codewords are zero-mean and average block-power con- 
strained to 1, then for sufficiently large blocklength n 
the input sequences ( |48] l and ( |49] l satisfy the power 
constraint (HI with arbitrary high probability. 

We next describe the decoding. The receiver first 
decodes the pair (Afi,cs,A^2) based on the tuple 
(Yi,...y,pi) by treating the codeword U(Afi^NF) as 
additional noise and by applying the inner and outer 
decoders of the concatenated scheme. Let A/ics and Af2 
denote the receiver's guesses of the messages Aiics and 
A./2,andlet (s'-', . . . , sl^^) and {kf^,...,^^^) 
denote the corresponding codewords in the outer codes. 
The receiver then attempts to estimate and subtract the 
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influence of the concatenated scheme (see ( |46] | and ( |47] |) 
by computing for each fee {1, . . . ,n} the difference 

Yfe ^ (l„ - Bi - B2) Yk - BiiE'^^k^ - a2Sg\ (50) 
where the Ty-dimensional vector Yj. is defined as 

Yfe = (Y(fe_i),,+i, . . . , Ykj^y. 

If the receiver decoded Mi cs and M2 correctly, i.e., if 
Mi.cs = Afi.cs and M2 ~ M2, then (ISOl l corresponds 
to 

Ufe + BiWi,fe + B2W2,fe + Zfe, fc e {1, . . . , n}. 

Finally, the receiver decodes Message A/i^nf based on 
the differences {Yijf^i using an optimal decoder for 
a Gaussian 77-input antenna/77-output antenna channel 
where the noise sequences are white but correlated across 
antennas. Notice that because of the correlation of the 
noise sequences across antennas, the scheme might be 
improved if correlated Gaussian codewords are used to 
transmit Message Mi.nf- 

2) Rate-Splitting with Carleial's Scheme: Our second 
extension is based on modifying Carleial's rate-spUtting 
scheme |2]. Carleial's scheme combines a variation of 
the Cover-Leung scheme [4J with a no-feedback scheme 
by means of rate-splitting. Here, we propose to modify 
his scheme by replacing the no-feedback scheme with 
our concatenated scheme. Since for 77 = l,ai = a/PI", 
and 02 = ^/P2 our concatenated scheme results in an 
optimal no-feedback scheme, our proposed extension 
includes Carleial's scheme as a special case. In the fol- 
lowing we roughly sketch the idea behind our extended 
scheme. For more details see Section |H] 

Our scheme is a Block-Markov scheme of block- 
length n' . Each block of n' channel uses is divided 
into [B + 1) blocks, each of length rjn for positive 
integers -q and n, i.e., we assume that n' = {B + l)rin. 
Each transmitter splits its message into two sequences 
of independent submessages: Transmitter for v e 
{1,2} splits its message A/^ into a sequence of inde- 
pendent submessages {M^^cl,i, ■ ■ ■ , M^^cl,b} of rates 
Ri^.CL and into a sequence of independent submessages 
{M^^cs,i, M„^cs,b} of rates R^^cs- The rates R^^^cl 
and i?j/,cs should be nonnegative and sum to R^^^, 
but otherwise can be chosen arbitrary depending on the 
parameters of the setting. Similarly, for Transmitter 2. 
(Here, the subscript CL stands for "Cover-Leung" and 
the subscript CS stands for "concatenated scheme".) 

As in Carleial's scheme, after each block h E 
{!,..., 5} Transmitter 1 and Transmitter 2 decode 
the other transmitter's submessage A/2,CL.h and A/i cL.b 
based on their feedback outputs. The two transmitters 
can accomplish the decodings in two different ways. 
Transmitter 1 either directly decodes Message A/2.cL.fc, 
or it first decodes Af2,cs,6 before decoding the desired 
message A/2.CL.fc- Which alternative is better depends on 
the specific parameters of the setting. 



The encoding is performed as follows. To encode 
messages {M^,cL,b}f,^i Transmitter ly, for e {1,2}, 
uses Carleial's variation of the Cover-Leung scheme and 
to encode messages {M^ cs,b}^^i it uses our concate- 
nated scheme. More specifically, before the transmission 
in Block b E {1, . . . , B} starts. Transmitter u chooses 
the codewords for messages Afj/,cL,b, Mi cL,h-i, and 
A/2,CL,b-i from the corresponding Gaussian codebooks 
and produces an 7771-length sequence of power P^, for 
some < P/, < P,y, by taking a Unear combination 
of the chosen codewords. It also produces an rjn-length 
sequence of power (P^ — Pi) by encoding message 
Ali^.cs.b using the outer and inner encoders of our 
concatenated scheme where 77 is the parameter of the 
inner code and n is the blocklength of the outer code. It 
sends the sum of the two produced sequences in Block b. 
In Block {B + 1) Transmitter picks the codewords for 
messages Mi ql.b and M2.cl,b from the corresponding 
Gaussian codebooks and sends a linear combination of 
power P^ of these codewords. 

After each Block fee {1, . . . , B} the receiver decodes 
messages A/i,cs,6, A/2,cs,hAfi,cL,b-i, and A/2,CL,h-i- 
It first decodes messages Afi cs.fc and Af2,cs,b using 
inner and outer decoder of our concatenated scheme and 
treating the sequences produced by encoding messages 
A/i,cL,b-i, Af2,CL,fc-i, Mi,cL,6 and M2,cL,b as additional 
noise. From its guess of (Afi cs.fc, Af2,cs, ft) the receiver 
cannot recover the sequences produced by our concate- 
nated scheme because it is incognizant of the feedback 
noise. Nevertheless, it can form an estimate of both 
produced sequences (pretending that its guess is correct) 
and subtract the sum of the estimates from the received 
signal. Based on the resulting difference and based on 
similar differences which resulted in the previous block, 
it then decodes messages (Afi_cL,fc-i, M2,cL,fc-i)- After 
the last block {B + 1) the receiver decodes the pair 
(A/i,cL,s, Ai^2,CL,s)- More general decoding orders at 
the receiver could be considered, but for simplicity, we 
restrict attention to this order. 

3) Interleaving & Rate-Splitting with Carleial's 
Cover-Leung Scheme: Our third extension is based on 
rate-splitting an interleaved version of Carleial's Cover- 
Leung scheme with an interleaved version of our con- 
catenated scheme. We only describe here the general 
structure of the scheme. For more details see Appendix|T] 

Our scheme is a Block-Markov scheme of block- 
lenght n' . Each block of n' channel uses is divided 
into {B + 1) blocks, each of length rjn and each 
such block is further divided into 77 subblocks of 
length n. Thus, it is assumed that B, ij, and n are 
positive integers such that n' = {B + l)?/n. Simi- 
larly, each transmitter splits its message into two se- 
quences of independent submessages: Transmitter i/, for 

e {1,2}, splits its message Af^ into a sequence 
of independent submessages {Afix.icL.i, • ■ • , Af^.icL.r^s} 
and into a sequence of independent submessages 
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{M^,iC5,i, • ■ • , M^ ics.b}- Notice that the first sequence 
of submessages is of length rjB, and the second of length 
B. Messages {Mj,jcL,(6-i)r;+£}f=i are of rate Ru,icui, 
and Messages {M^jcs.hj^i of rate i?i,ics- The rates 
-Ri/,iCL,i, • • ■ , Rv.iCL,i), and R^jcs should be nonnegative 
and sum to Rv^^, but otherwise can be chosen arbi- 
trary depending on the parameters of the setting. (The 
subscript ICL stands for "interleaved Cover-Leung" and 
the subscript ICS stands for "interleaved concatenated 
scheme".) 

Similar to the previous extension and similar to 
Carleial's scheme, the transmitters decode part of the 
other transmitter's messages based on their feedback 
outputs. Specifically in this scheme, after each subblock 
h £ {1, . . . ,Brf\, Trasmitter 1 and Transmitter 2 de- 
code the other transmitter's submessage ^ and 
ICL b- Following this decoding step, the transmitters 
compute "cleaned" feedback outputs, i.e., they mitigate 
the influence of the Cover- Leung messages Afj^ 

^2,iCL,fc' ^'^i,iCL,6-„' and il/a.iCLi-,, ti'ansmitted in this 
block on the observed feedback outputs. Transmitter 1 
computes its "cleaned" feedback output more specifi- 
cally as follows. It first reconstructs the sequence that 
was produced by Transmitter 2 in this subblock b to 
encode messages A/2,icL,h' ^^i,icl,&-„' and M2 jcLi-„ 
(pretending that its guesses of f, and l-r) 

are correct). It then subtracts this reconstructed sequence 
and the sequence it produced itself in this subblock to 

encode Af^ icL,h, ^^i,icL,fc-^' and M^ ^^l,!,-^ from its 
observed feedback outputs. Similarly for Transmitter 2. 

The encoding is performed as follows. To encode 
Messages {Af,y_icL,fc}/?f 1, Transmitter i/, for e {1,2}, 
uses an interleaved version of Carleial's Cover-Leung 
scheme, and to encode Messages {A/^.ics.hj^i it uses 
an interleaved version of our concatenated scheme. We 
describe these encodings in more detail. In a fixed 
block b G {!,..., B}, Transmitter ly sends the sum 
of two r/n-length sequences. The first sequence is of 
power P^, for some < P,^ < Pi,, and consists of 
rj subblocks. The ^-th subblock of the sequence, for 
£ G {1, . . ■ ,ri}, Transmitter i/ chooses the n-length code- 
words for Messages Af^_icL,(b-i),,+f , Mi_icL,(fc-2),,+<', 
and Af2.icL,(6-2)i)+f from the corresponding Gaussian 
codebooks and takes a linear combination of these 
chosen codewords. We notice that here each pair of 
messages (MijcL.h' ^^2,icl,&)' fo"" ^ ^ {!,..., Br]}, 
is encoded into Subblocks b and b + 77, and not — as 
in Carleial's original scheme — into Subblocks b and 
6+1. The second sequence is of power (Pi — P[) 
and produced as follows: Transmitter u first applies its 
outer encoder to encode Message Af^.ics.b, and then 
feeds the outcome to a modified version of its inner 
encoder. The inner encoder is modified as described 
by the following two items. 1.) Instead of the original 
feedback the modified inner encoder uses the "cleaned" 



feedback mentioned above, where the influence of the 
interleaved Cover-Leung type scheme is mitigated. 2.) 
Unlike the original inner encoder where the £-th fed 
codeword symbol is encoded into 77 subsequent symbols 
at positions — 1)77+1 to £rj, the modified inner encoder 
encodes the £-th fed codeword symbol into the rj symbols 
at positions £, n + £, . . . , {rj— 1)71 + ^, for £ E {1, . . . , 77}. 

Notice that the chosen interleaving of the modified 
inner encoders preserves the causality of the feedback. 
Moreover, it implies that in the interleaved sequence the 
symbols in Subblock b, for b G {{b — 1)77 + 1, . . . , brj}, 
only depend on feedback outputs of previous subblocks 
1, . . . , 6 — 1 and not on feedback outputs of the current 
Subblock b. This is the reason why the modified inner 
encoder can use the "cleaned" feedback instead of the 
original feedback. 

The receiver first decodes Messages {M^ j^^^ feJ'g-'i 
and {Af2 b}],^i and only thereafter decodes 
Messages {A/i,ics.b}f=i and {IVhjcsALv More 
specifically, the receiver first decodes Messages 
{(^^i,iCL,(fc-i),,+i,Af2,iCL,(b-i)r,+i)}f=i, followed by 
Messages {(Afi,icL,(b-i)r,+2, M2,icL,(ft-i)»j+2)}f=i, etc. 
The receiver then reconstructs the sequences produced 
to encode these messages (pretending its guesses are 
correct) and subtracts them from the received signal. 
Based on the resulting difference, which we call the 
"cleaned" output signal, the receiver decodes Messages 
{Mi.iC5,b}b=i and {Af2,ics,b}f=i- To this end, it first 
reverses the interleaving and then applies the inner and 
outer decoders of our concatenated scheme. 

Notice that in the presented scheme. Messages 
{Mijcs.blf^i and {Af2,ics,h}f=i are decoded based on 
the "cleaned" output signal and they are encoded using 
the "cleaned" feedbacks. The "cleaned" output signal 
and the "cleaned" feedbacks correspond to the output 
signals and the feedbacks in a situation where only the 
interleaved concatenated scheme is employed but not the 
interleaved version of Carleial's Cover-Leung scheme. 
Therefore, in the presented rate-splitting scheme there 
is no degradation in performance of the interleaved con- 
catenated scheme due to the rate-splitting with Carleial's 
Cover-Leung scheme. 

Further, notice that in a given Block b E {1, . . . , B} 
the sum of the two sequences produced to encode 
Messages A/i_ics,fc and Af2,ics,6 is of different power in 
each of the 77 subblocks. Thus, these sequences introduce 
different noise levels on the receiver's decoding of 
Messages {(AfijcL,(6-i),,+^, A^2,icl,(6-i)»j+£)}Li' and 
consequendy the rates {Ri,iclA1=i and {i?2,iCL,£}Li 
should be chosen depending on £. 

E. Proofs 

1) Proof of Proposition \IV.5\ We first prove Part[T]i. 
To this end, we show that for every fixed 77 e N and 
fixed 77-dimensional vectors ai,a2, 77 x 77-dimensional 
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matrices 81,62, and 2 x ?7-dimensional matrix C, the 
following two statements hold: 

i) For all positive semidefinite matrices KwiW2 ^"d 
^'wiW2- 

(n {N, 1^2 ; ^7, ai , a2 , Bi , B2 , C) 
cn{N, KV,w2;'?'ai,a2,Bi,B2,C) 

ii) If the choice of parameters 77, ai, a2, Bi, B2, C 
satisfies the power constraints ( fT9l ) for a covariance 
matrix Kvi/-iW2 5 then it also satisfies these power 
constraints for all covariance matrices K'iyiW2 ^'^^ 
which KwiW2 h ^'wiW2- 

By Definition IIV.2I Statements i) and ii) imply that 



n{Pi,P2,N,Kw,W2] 



c7^(Pl,P2,A^, k; 



W1W2} 

and thus conclude the proof of Part[T]i. 

We start by proving Statement i). Fix a tuple 
(77, ai, a2, Bi, B2, C). We only prove Statement i) for the 
case where CC^ is nonsingular. For the case where CC^ is 
singular but C ^ the proof is analogous and therefore 
omitted; for C = the proof is trivial. To establish 
Statement i) when CC^ is nonsingular, it suffices to 
show that all three RHSs of ( fTSl l are monotonically 
decreasing in KwiW2 with respect to the Loewner order 
We only prove the monotonicity of the RHS of ( I18ab : 
the monotonicities of the RHSs of ( I18bb and ( I18cb can 
be shown analogously. Thus, in the following we fix two 
positive semidefinite 2x2 matrices KwiW2 ^\y^w2 
satisfying KwiW2 ^ ^'^11^2 show that: 



1 

2^ 



log 



|C(aial + N\n + B,{Kw,W2 KWr)C\ 



2r) 



|C(iVI„ 
|C(aia\ - 



-Br(K 
NL 



W1W2 



W1W2 



c(ivi,, + b,(k; 



W1W2 



(51) 



Before proving ( BTl i we recall the following well- 
known properties of positive semidefinite matrices. For 
all positive semidefinite nxn matrices K, Ki, K2 satisfy- 
ing Ki >: K2 and for all mxn matrices M the following 
properties hold: 



and 



MKiM^ >z MK2M^ 
K + Ki ^ K + K2, 
KKi h KK2, 



|Ki|>|K2|, 
tr(Ki) >tr(K2) 



(52) 
(53) 
(54) 
(55) 

(56) 
(57) 



Based on these properties and the definition Ai ^ aia\ 
the following sequence of implications can be proved: 



W1W2 



W1W2 



(KtViM/a ® !>)) ^ (^^11^2 ® 



(B,(K 



W1W2 



I,) Bj) h (B, (k; 



W1W2 



{N\r, + B,{Kw^W2(^K)^l) 

h {N\, + B,iK'^^^^ ® I,)BJ) 
(C(A^I^ + B,{Kw,W2 ® ln)^1)C) 
t {C{N\^ + B,{K'^^y^,^<E>\^)Bl.)C) 

{C{N\r, + B,{Kw,W2 ® \n)^l)CT^ 
^ {C{NU, + B,{K'^^y^,^<E>\r,)Bl)C) 



I2 + CAiC {C{N\„ + B,{Kw,W2 ® I^)B;)C)" 



^ (I2 + CAiC (C(7VI„ + B,iK'^^^^ ® I,,)BJ)C 



(58) 
(59) 



(60) 



(61) 



(62) 



(63) 

where ( [58] l follows by the linearity of the Kronecker 
product (g) and because for every positive semidefinite 
matrix K also the Kronecker product K (g) 1^ is positive 
semidefinit43 where ( ISST l follows by (ISZt : where ( |60] | 
follows by (l53T l and because A^l^ ^ 0; where i6T[ 
follows by ( l52] i: where ( |62] | follows by ( fSST i: where ( l63T l 
follows by ( l54l i and (ISSl l and because Ai ^ 0, and thus, 
by (|52ll, also CAiC h 0. 

Inequality ( Bil l follows then from ( |63] l. from (|56] l, 
from the monotonicity of the log-function, and from the 
fact that for every 2x2 positive semidefinite matrix K, 
for Ai as defined above, and when CC^ is nonsingular: 

J_ / |C(aial+7VI^ + B,(K^I^)BJ)Cr 
27]°^\ |C(7VI,, + B,(K(gl^)BJ)C| 
1 



2r, 



log 



I2 + CA1C 
• (C(iVI„ + B,(K'^^^^ 



which holds because for all nonsingular square matrices 
Ml and M2 of the same dimension 



|Mi| 



12 ...^ .^...^ — i^^i 

This concludes the proof of Statement i). 

We next prove Statement ii). It suffices to show that 
for fixed parameters 77, ai, a2, Bi, B2, C, the left-hand 
sides of the power constraints iT% are monotonically 
increasing in KwiW2 with respect to the Loewner order. 

'"That K y implies (Kcg)l) y can be seen as follows. For every 
2»;-dimensional vector x = {xi, . . . ,a;2r;)^, where we define = 
{x2i—i, X2iy for i £ {1, . . . , t;}, and every 2x2 positive semidefinite 
matrix K the term x^(K(gil^)x can be written as y^^_-^ xjKxi, 
which is nonnegative since K is positive semidefinite. 
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Similarly to the proof of Statement i), this can be shown 
by a sequence of implications based on (l52T i. on ( l53b . 
on ( |57l ). on the fact that KwiW2 ^ ^'wiW2 ™pli2s 

the trace of a sum equals the sum of the traces. The 
details are omitted. 

We prove Part |2]i. The inclusion of the LHS in the 
RHS is trivial, because for every positive S all choices 
of parameters 77, ai, a2, Bi, B2, C satisfying the power 
constraints iT% for powers (Pi — (5) and {P2 — S) satisfy 
the power constraints also for powers Pi and P2. 

The inclusion of the RHS in the LHS is proved as 
follows. We fix a rate pair (i?°,i?2) in the interior of 
niPi,P2,N,Kw,W2l i.e., 



{RIR°^) eniPuP2,N, Kw,W2) : 



(64) 



and show that for all sufficiently small S > the rate 
pair can also be achieved with powers Pi — 6 and P2 — 5, 



I.e., 

{R°i,R°2) e 7^ (Pi - 5, P2 - 6, N, Kw,W2) ■ (65) 

We first choose parameters 77', a'l, aj, B'l, 82, C so 
that the power constraints (l% are satisfied for powers 
Pi and P2 and so that 

(i?J,i?°) e7^(iV,KwlW.;r?^a'l,a;,,B;,B^,C'). (66) 

By ( |64| |. such a choice always exists. Moreover, for 
such a choice the matrix C differs from the all-zero 
matrix and both vectors a'l and a'2 differ from the 
all-zero vector. This can be argued as follows. It is 
easily shown that if C = 0, a'l = 0, or aj = 

then the region TZ{N,KwiW2tV' 7^ii^2i^'i^^'2t^') is 
degenerate, i.e., either Pi = for all points in the region 
or P2 = for all points in the region. Consequently, 
the region TZ{N,K\YiW2iV' 1^11^2 ^'21^') cannot 
contain any interior points of TZ {Pi, P2, N,KwiW2)' 
thus contradicting ( |66] |. 

We next define for each S > Q the quantities ki{S) 
and K2{S) as in ( l67b on top of the next page, and we 
define 

k{S) = mm{Ki{S), K2{S)}. 

Since a'l and a'2 both differ from 0, the denominators in 
(I67al l and ( I67bb are non-zero and the quantities ki{S), 
K2{S), and k{S) are well defined. Moreover, k{S) tends 
to 1 as (5 4, 0. 

The desired inclusion ( l65b is then established by show- 
ing that for all sufficiently small S > Q the following two 
statements hold. 

i) The parameters 77', K{S)a'i, K{5)a2., B'l, 63, C sat- 
isfy the power constraints il9[ for powers (Pi — 6) 
and (P2 - 6). 

ii) The rate pair {R'^jR'^) lies in the region 
n {N, Kw,W2;v', K{S)a'i,KiS)a'2, B[, B^, C) . 

Statement i) is easily verified by substituting the pa- 
rameters 77', K((5)a'i. K((5)a2, B'l, B2, C into the LHSs 



of the power constraints fT% and using the fact that 
the parameters rf , a'l, a'2, B'l, B'2, C satisfy these power 
constraints for powers Pi and P2. Statement ii) fol- 
lows because for given parameters 77,81,82, and C 
the RHSs of Constraints ( fTSl ) — which define the region 
TZ {Pi ,P2,N, KwiW2 '■ ) when C 7^ — are continuous in 
the entries of ai and a2, and because k{S) tends to 1 as 
(510. 

We finally prove Part (3]), i.e.. Equality ( l20l i. The 
inclusion of the LHS in the RHS is trivial, because 
replacing the intersection on the LHS by the specific 
choice K = can only increase the region, and because 
the region TZ {Pi, P2, N,0) is closed. The interesting 
inclusion is that the LHS contains the RHS. To prove 
this inclusion, we first notice that 

cl I U n TZ{Pi,P2,N,K) 
Del U fl 7^(Pl,P2,7V,tr(K)l2) 

\cr2>0 KtO:tr(K)<(T2 



Cl( U n{Pl,P2,N,C7%)\ , 



where the inclusion and the equality both follow by the 
monotonicity proved in Part[T]). Thus, it remains to show 
that 

cl[ y n{Pi,P2,N,a^\2)] D7^(Pl,P2,iV,0).(68) 

To prove ( |68] ), we fix a rate pair {R'^,R!^) in the 
interior of TZ {Pi, P2, N,0), and show that for all suf- 
ficiently small cr^ > there exists a set of parameters 
77, ai, a2, Bi, 82, C satisfying the following two state- 
ments. 

i) The parameters 77, ai, a2, 81, B2, C satisfy the 
power constraints ( fT9] l for feedback-noise covari- 
ance matrix KwiW-, = cr^b and powers Pi and 
P2. 

ii) The rate pair (PJjPj) lies in the region 

TZ{N, a%;ri, ai,a2,Bi,B2,C). 

We first notice that by Part m, for all sufficiently 
small (5 > the pair (PJjPj) lies in the interior of 

TZ {Pi -5,P2- 5, N, 0), i.e., 

{R°i,R°2) e 7^ (Pi - 5, P2 - 5, N, 0) . 

This implies that for all sufficiently small 
(5 > there exists a set of parameters 

{'n{5),ai{5),a2{5), Bi{5), 82(5), C{5)) so that 

• the power constraints ( fT9] l are satisfied for 
feedback-noise covariance matrix \^WiW2 — ™d 
powers (Pi — (5) and (P2 — (5); and 
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Srj 

tr((l„ 0)(l2„-Bb)"'AdA5(l2^-Bb 



St] 



tr ( (0 I,,) (b^ - Bb)-' AdAJ ihrj - B^)-' L° 



(67a) 



(67b) 



* the rate pair (i?J,i?2) satisfies 



(i?i,i?2) 

e 7^ (iV, 0; 7](<5), ai((5), a2(<5), B,{S), B^iS), C{6)) . 

(69) 

The proof is then established by fixing a suffi- 
ciently small (5 > 0, and showing that for all 
sufficiently small > the choice of parame- 
ters (?/((5),ai(^),a2((5),Bi(5),B2((5),C(5)) satisfies the 
above Statements i) and ii). 

Statement i) holds because for K\YiW2 = "'^b 
the LHSs of the power constraints (fT9] l are con- 
tinuous in cr^ > 0, and because the parame- 
ters (7/((5),ai(5),a2(5),Bi(5),B2((5),C(5)) satisfy the 
power constraints for feedback-noise covariance matrix 
^WiW2 = and powers {Pi — S) and {P2 — S). 
Statement ii) holds because for KwiW2 — f the RHSs 
of Constraints (fTSl l — which define the region region 
TZ{N,KwiW2tV:^1:^2,Bi,B2,C) when C — are 
continuous in cr^, and because of Inclusion (|69] |. 

2) Proof of RemarkME\ Fix Pi,P2,N > 0. Special- 
izing our concatenated scheme to the specific choice of 
parameters in Remark lA. 14l obviouslv cannot outperform 
our concatenated scheme for general parameters. Thus, 

cl IJ {Pi,P2,N, 0) C 7^ {Pi,P2,N, 0) . (70) 
\nen J 

We shall show in the following that 

nQPi,P2,N)cci \Jn^{PuP2,N,o) \ , (71) 

\»)eN J 

which combined with dTOl i establishes the remark. 

Recall that for fixed 77 € N the region 
TZrj{Pi, P2, N,0) is defined as the set of all rate 
pairs {Ri,R2) satisfying Constraints ( |72] i on top of the 
next page where 

Pi=~p*{Pi,P2,N) (73a) 
and for {2, . . . , 77 - 1}: 



JPi(l - pti) + n Jp2{1 - Pti) +N 

(73b) 



and where r is the unique solution in [0, 1] to (I185I I. i.e., 
to 



r^PiP2 



(rPi + N){rP2 + N) 



p*iPi,P2,N). 



We shall shortly prove that the solution to the recur- 
sion (l73T l is 

Pi^i-lYp*iPi,P2,N), eeN. (74) 
This implies that for all £ € N larger than 1: 

2 *2 

Pe-1 = P > 



P 



and hence for fixed 7; e N the region (Pi , P2 , iV, 0) 
contains all rate pairs (Pi,P2) satisfying: 



^ . f rPx 



1 / rPo 
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Ids 



1 



N 



P2{l-P*^) 



N 



(75a) 



(75b) 



1 , / rPi+rP2 
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A , Pl+P2+2^/T\P'2P* 

■ log 1 + 



N 



(75c) 



Notice that when 77 tends to infinity, the RHSs of ( I75al )- 
( I75cl ) tend to the RHSs of the three Constraints (iTali-dTcli 
evaluated for p — p* . Since Constraints (iTali-dTcb eval- 
uated for p = p* determine the region TZq-^{Pi, P2, N), 
Inclusion ( fTTT i follows immediately by ( |75] | and by letting 
77 tend to infinity. 

In the remaining, we prove ( l74l i in two steps. In the 
first step we show that p* {Pi, P2, N) is a fix point of 
the function L( ) defined as 



L : 

Hp) 



[0,1] 



V/Pl(l - + 7VVP2(1 - p2) + iV 
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R2 



If rPi 



1=2 

n 



2-q 



N 
N 



i?i+i?2<2^1o8|l + ^^j+g-log [1 + 



(72a) 
(72b) 
(72c) 



Notice that L(-) has at least one fix point in [0, 1] because 
L(0) > whereas L(l) < 0, and because L(-) is 
continuous. Further notice that every fix point of L(-) 
must also be a solution to 



l-L(p)2 = l-p2 



i.e., a solution to 



(76) 

The solutions in [0, 1] to ( |76] ) are given by p = 1 and 
by the solutions to 



N{N + P1+P2 + 

= (TV + Pi(l - p^)){N + P2(l - p'')). (11) 

Since p = 1 is not a fix point of L(-) and since 
p* {Pi ,P2,N) is the unique solution in [0, 1] to dTTji (see 
Definition IIII.ll ). p* {Pi ,P2,N) must be a fix point of 
L(-). This concludes the first step. 

In the second step we use the derived fix-point prop- 
erty of L( ) to prove ( l74b . The proof is lead by induction. 
For £ = 1 Condition (|74] | holds by definition. Assuming 
that ( |74| | holds for some fixed £ > 1, we have 



-{-lYVl\P2{l-\pt\'')+PiN 



^Pi{l-\p,\') + N^P2{l-\pt\^)+N 
(^^If+i. VKP2{l-\Pi?)~\Pi\N 



(78) 



- \pt?) + N^P2{1 - |pf |2) + N 

(79) 

= {-lY+'h{\pA) (80) 
= {-lf+^p*{Pi,P2,N), (81) 

where (l78l l follows by the definition of the sequence 
{pt] for £ > 1; (l79l l follows because by the induction 
assumption sign(p^) — (—1)^; dSOl l follows by the 
definition of the function L( ); and finally (IHTl ) follows 
because by the induction assumption \pg\ = p* and 
because p*, as shown in the first step, is a fix point of 
L(-). Thus, ( l74l i holds also for {£ + 1), which concludes 
the induction step and the proof of the remark. 



3) Proof of Lemma \IV.15\ : We only prove Inclu- 
sion (I26ab : Inclusion ( I26bb can be proved analogously. 

Fix p e [0, p*], and define a(p) as the unique solution 
in [0,1 [to 



P1+P2 + 2^I\P^p + N ^2(1-1^ 



Pi(l-p2) + 7V ^' aPi+N ' ''^^^ 

That ( |82] | has exactly one solution in [0, 1) follows 
by the Intermediate Value Theorem and the following 
observations: The RHS of ( |82] i is continuous and strictly 
decreasing in a; for a = the RHS of (|82] | is larger 
or equal to the LHS because < p < p* and by 
Remark IIII.3I and for a tending to 1 the RHS tends 
to —00 and thus is smaller than the LHS. 
Further, define 

P[^a{p)Pi, 
Pi"^(l-a(p))Pi, 
N' ^ P[ + TV, 



and notice that by these definitions: 



N'{N' + P'l +P2+ 2/P[^p') 

= {N' + P'{{1 - p'2))(iV' + P2(l - p")), (83) 
and hence 

p'=p*(Pr,P2,iV')- 

Also, define (Pioz'^2 0z) dominant corner 

point of the rectangle TZ'^ q^{Pi, P2, N). The following 
two remarks on (P^ q^, q^) are from 1 13 1, and based 
on 



Remark IV.18. The rate point (Pioz'^2 0z) 
expressed as 

^l,Oz — ^1,1. Oz ^ ^l,2.0z' 



where 



<i,Oz-^log(l + §), 



<2,Oz-2^°^''^ 



p{'{i-p"y 



N' 
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Remark IV.19. The rate point (^i2 0z'^2 0z) corre- 
sponds to the dominant corner point of the rectangle 
ni{P{',P2,N'), where p' = p*{Pi' , P2, N'). 



The I) -direction, i.e.. 



We are now ready to prove Inclusion ( I26al i. For 
Kw^w^ = the RHS of (El equals i log (l + 
irrespective of the parameters ai, a2, Bi, B2, C. There- 
fore, the region 7?.rs,i {P{, -?{', P2, N, 0) is given by the 
set of all rate pairs {Ri , R2) which for some nonnegative 
^i,cs,-Ri,NF summing to Ri satisfy 



(i?l,CS,i?2) G n{P[',P2,N',0), 
i?l,NF < ^l0g(l + ^ 



(84a) 
(84b) 



Since by Remark |IVT9l and Remark HVS] 

(^?,2,oz>^2,oz) e7^(p^^P2,iv^o) 

and by Remark |IVl8l 

Pi 



<i.Oz<olog(l + ^), 



the triple (^-Ri 1 ozi ^1 2 Oz' ^2 Oz) satisfies ( |84] |. and 
hence 

{Koz^ Ko) e 7^Rsa [PiP^, P2, N, 0) . (85) 

Inclusion ( I26al i finally follows because (^^i^oz' ^2.0z) 
is the dominant corner point of the rectangle 
TZ{q^{Pi,P2,N), and therefore (l85]l implies that 
the entire region TZ^ q^{Pi, P2, N) is contained in 

nKSAiPi,Pi',P2,N,d). 

4) Proof of Proposition \IV.16\ : We only prove Inclu- 
sion ( I27ab : Inclusion ( I27bl l can be proved analogously. 

To this end, fix a p e [0, p*{Pi,P2,N)] and choose a 
power P{ e [0, Pi] such that 

nKs.iiP[APi-P[),P2,N,0)Dnlo^iPi,P2,N).m 



Notice that by Remark IIV.15I such a power P[ always 
exists. Inclusion ( |27at follows then because by Proposi- 
tion HvH Part 2.: 



cl 



U n nRs,i{P[,{Pi-Pi),P2,N,K) 

tl-(K)<cr^ 

= nRss{P[,{Pi-Pi),P2,N,o). 



5) Proof of Theorem WT7\ Fix PuP2,N > 0. 
The proof of the C -direction follows trivially because 
replacing the intersection on the LHS by the specific 
choice K = can only increase the region, because 

CNoisyFB(Pl,P2,iV,0) = CperfectFB (A , ^2, A^), and bc- 

cause by definition the region CperfectFB(-pL, -P2, A^) is 
closed. 



cl 



U n CNoisyFB(Pl,P2,A^,K 

-2>0 K^O: 
tr(K)<(T^ 

3 CperfectFB (^'l ,P2,N), 



follows from the sequence of inclusions (l87]i-(|90ll on 
top of the next page. Inclusion dSTb follows from Propo- 
sition II V. 131 dSSl l follows by basic rules on sets; ( [89] l 
follows from Proposition |IV.16t and ( |90l ) follows by 
Remark UlLTl 



V. Partial Feedback 

We now focus on the setup with noisy or perfect 
partial feedback. For this setup we again present new 
achievable regions, and based on these new regions we 
derive new qualitative properties of the capacity region 
(Section IV-Ab . We also present the coding schemes 
corresponding to these new achievable regions (Sec- 
tions IV-BHV-E)] l. They are obtained from the noisy- 
feedback schemes in Sections IIV-BIITV^ by restricting 
the set of parameters and in the case of the extended 
schemes by additionally specializing Carleial's scheme 
to noisy partial feedback. 



A. Results 

We first present results for noisy partial feedback 
(Section Fy-All i and then results that hold only for perfect 
partial feedback (Section IV-A2b . 

1 ) Results for Noisy Feedback: Evaluating the rates 
achieved by our concatenated scheme with general pa- 
rameters in Section lV-Cll ahead leads to the achievability 
result in Theorem IV.3I Before stating the result we 
define: 

Definition V.l. Let rj be a positive integer, let ai,a2 
be rj-dimensional vectors, let B2 be a strictly lower- 
triangular rj X rj matrix, and let Cp be a 2 x rj ma- 
trix. Then, depending on the matrix Cp the rate region 
TZp (iV, trl ; 77, ai , a2 , B2 , Cp) is defined as follows: 

• If the product CpCp is nonsingulai^ then 
72,p (A^, (t|; ?7, ai, a2, B2, Cp) is defined as the set 



' ' Whenever »j G N is larger than 1 , there is no loss in optimaHty in 
restricting attention to matrices Cp so that CpCj is nonsingular. 
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Cl U fl CNoi,syFB(Pl,P2,iV,K) 

\(t2>0 KbO:tr(K)<a2 

2 ( u n ( f u (Pi (Pi - p[), P2,N, K) 

\(t2>0 KtO:tr(K)<<T2 \\P^e[0,Pi] 



U 



U 7^Rs.2(Pl,P^,(P2-P^),A^,K) I I I (87) 



Del u cl u fl 7^RS4(A^(A-p^),P2,iv,K) 

\P{e[0,Pi] \a2>0 KtO:tr(K)<(T2 

U Cl U Cl U fl n^s.2{Pi,PiAP2-P2),N,K)]] (88) 

\P^e[0,P2] \cr2>0 KbO:tr(K)<(T2 / / 

2cl| y 7^?o.(A,i^2,iV)) U cl I y 7e^o,(Fi,F2,7V)| (89) 

\pe[o,p*(Pi,P2,Af)] / \pe[o,p'{PuP2,N)] J 

= CperfectFB(Pl,P2,iV), (90) 



of all rate pairs (i?i,i?2) satisfying 



NL 



0-16262) Cpl 



n 1 , |Cp (aia; 

""^-2,7°^ |Cp(iVI,, + a262e^2)QI 



1 |Cp (a2a^ +N\,,-tLi^D2D2) 
^'-2r?°^ |Cp(iVI„ + ai626^2)QI 



(91a) 

-T I 
-P| 



Ri 



+ R2 



(91b) 

|Cp (A,.A^ + 7VI^+a| 626^)^1 



|Cp (7VI^ + a| 626^2)^1 



(91c) 



where A, is defined in dl 11 1. 
• //■ f/ie product CpCJ, /i singular but Cp 7^ 0, f/zen 
7?,p (-/V, cr|; ?/, ai, a2, 62, Cp) defined as the set 
of all rate pairs {Ri,R2) satisfying ( 1911 ) when the 
2 X 77 matrix Cp is replaced by the rj-dimensional 
row-vector obtained by choosing one of its non-zero 
rows. 

» If Cp — 0, then 7?.p (-/V, (t|; ry, ai, a2, 62, Cp) is 
defined as the set containing only the origin. 

An alternative formulation of the region 
TZy {N, cr|; 77, ai, a2, 62, Cp) is presented in Section[ 

Definition V.2. Define 
7^P {P,,P2,N,ai) 

= cll y 7^p(iV,a2;,7,al,a2,62,Cp) ] ,(92) 

\ Jj,ai,a2,B2,Cp 



where the union is over all tuples (77, ai, a2, 62, Cp) 
satisfying the trace constraints 



(93a) 



and 



tr(^(l^ - 62)-^(a2a^ + 62aia;6^ 

+ iN + al)B2Bl) (l„ - 62)-'' ) < r;P2. (93b) 



Theorem V.3 (Noisy Partial Feedback). The capac- 
ity region CNoisyPartiaiFB(-Pi, -P2, A^, ct|) of the two-user 
AWGN MAC with noisy partial feedback to Transmitter 2 
contains the rate region TZp (Pi, P2, N,(T2), i.e., 

CNoisyPartidFB [Pi , P2 , N , a^) D Up (Pi , P2, N , a^) . 

Proof: Follows from Theorem |IV. 31 by choosing 61 
as the all-zero matrix. ■ 

Remark V.4. Evaluating the achievable region 
TZp {Pi, P2, N,a2) seems to be difficult even 
numerically. More easily computable (but possibly 
smaller) achievable regions are obtained by taking 
the union on the RHS of i92\ only over a subset 
of the parameters ry, ai, a2, 62, Cp satisfying (|93l l. In 
Remark \A.9\ we present such a subset of parameters. In 
Section W-C2\ we present general guidelines on how to 
choose the parameters r], ai, a2, 62, Cp. 



Specializing Theorem I V.3 1 to equal powers channels, 
i.e.. Pi — P2 — P, and to ry — 2 and the choice of the 
parameters presented in Section lEll yields the following 
Corollary ES] 
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Rl 



i?l < - log 



i?2 < ^ log ( 1 



i?2 < 2 log ( 1 



2P + N {2P + N + al + ^al) (p + iV + a| + ^a?^ 



N"2) 




P 



{P + N){2P + N + al) 



2P + NJ {2P + N + al + ^al){P + TV + ^2 + ^^2) 



(94a) 
(94b) 



(94c) 



Corollary V.5 (Equal Powers and Noisy Partial Feed- 
back). The capacity region CNoisyPartiaiFB (^', N, cr|) of 
the two-user AWGN MAC with noisy partial feedback to 
Transmitter 2 and equal powers Pi = P2 = P contains 
all rate pairs (_Ri,i?2) satisfying Constraints \94\ on top 
of the next page. 
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From Corollary I V.5 1 it follows immediately that for 
equal-powers channels noisy partial feedback increases 
the capacity, no matter how large the noise variance > 
is. The following stronger result holds: 

Theorem V.6 (Noisy Partial Feedback is Always Bene- 
ficial). For all N,Pi,P2>0 and cr| > 

CnoFB {Pi ,P2,N)C CNoisyPaitialFB {Pl,P2,N, ) , (95) 

where the inclusion is strict. 



Proof: See Section EET] ■ 
2) Results for Perfect Partial Feedback: Specializing 
Theorem IV.3I to perfect partial feedback, i.e., to (t| = 
yields: 

Corollary V.7 (Perfect Partial Feedback). The capacity 
region CperfectPartiaiPB (A, -P2, ^) of the two-user AWGN 
MAC with perfect partial feedback to Transmitter 2 
contains the rate region TZp {Pi, P2, N,0), i.e., 

CperfectPartialFB (^1 , ^2 , iV) D 7^p (Pi ,P2,N,0). 



Specializing Corollary IV.7I to -q — 2 and the choice of 
parameters in Section IeT] yields: 

Corollary V.8. The capacity region 

CperfectPartialFB (-Pi, ^2,^^) of the tWO-USCr AWGN 

MAC with perfect partial feedback to Transmitter 2 
contains all rate pairs (Pi,i?2) satisfying 

1 , / 2Pi 



P2 2 



i?2 < - log 



-N 



N 



Ra 

< - log 
- 4 s 



P1+P2 



log 1 



N 
Pi 



P2+N 



P1+P2+N 



P2 



N 



2JP1P2 



Pi 



Pi+N P1+P2+N 



N 



With this Corollary IV. 8 1 at hand we can answer the 
question by Van der Meulen in |18 | whether the Coyer- 
Leung region equals the capacity region of the MAC 
with perfect partial feedback. 

Theorem V.9. Consider a two-user AWGN MAC with 
perfect partial feedback. For some powers Pi , P2 and 
noise variance N the inclusion 

ncL{Pl,P2,N) C CperfectPart.alFB(Pl,P2,A^) 

is strict. 



Proof: The inclusion is proved in Section IV-E2I by 
showing that for powers Pi = 1 , P2 = 5 and noise 
variance N = 5 the region in Corollary IV. 8 1 contains rate 
points that lie strictly outside the Cover-Leung region. 

■ 

The last two results are achieved by modifying 
the rate-splitting schemes for noisy feedback in Sec- 
tions IIV-D2I and IIV-D3I so as to apply also for perfect 
partial feedback. For details see Section [V-DI 

Proposition V.IO (Rate-Splitting for Perfect 
Partial Feedback I). The capacity region 

CperfectPanialFB(Pl,P2,^^) of the tWO-USer AWGN 

MAC with perfect partial feedback to Transmitter 2 
contains all rate pairs (i?i,P2) which for some 
nonnegative Ri.cl, Ri,cs summing to Ri, for some 
nonnegative i?2.CL, ^^2,cs summing to R2, and for some 
choice of pi,p2 e [0,1] and P{ € [0,Pi],P;^ € [0,P2] 
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(i?i,cs, i?2,cs) e 7^p ((Pi - P{), (P2 - P:^), A^cs) , 



where Nqs = {N + P{ 



Pi 



2/P[i^piP2). 



Proof: The rate region is achieved by modifying 
the rate-splitting scheme for noisy feedback in Section 
IIV-D2I as described in Section IV-DI Here, the version of 
the scheme in Section IIV-D2I is chosen where Transmit- 
ter 2 decodes the submessages encoded with the concate- 
nated scheme before decoding the submessages encoded 
with Carleial's Cover-Leung scheme. The analysis of the 
rate-splitting scheme is based on a genie-aided argument 
as in |14| and |24|. The details are omitted. ■ 

Proposition V.ll (Rate-Splitting for Perfect 
Partial Feedback II). The capacity region 
CperfectPartiaiFB(Pi,P2,A^) of the two-user AWGN 
MAC with perfect partial feedback to Transmitter 2 
contains all rate pairs (^1,^2) which for nonnegative 
(^^i,iCL,ij Pi,iCL,2, ^i.ics) summing to Ri; nonnegative 
(-R2,iCL,i, P2,iCL,2, P2,ics) Summing to R2; and for some 
choice o/pi, p2 e [0,1] and Pi G [0,Pi],P^ G [0, P2] 
satisfy all the 11 constraints ( |96t on top of the next 
page, where 



A^i ^ Pi - Pi + P2-P2 



^ [Pi - pim - p^) + N 



(Pi - P{ + P2 - P^ + iV) 

+2 



{P2-P;,) 



(Pi Pi) 



>\2 



{P2 P!2? 



(Pi - Pi + N) (Pi - Pi + P2 - P^ + TV) ■ 

Proof: The rate region is achieved by modifying 
the rate-splitting scheme for noisy feedback in Sec- 
tion lIV-D3] so as to apply also for perfect partial feedback 
(see Section [V-Db . and by choosing the parameters of the 
concatenated scheme as r/ = 2 and as described in Re- 
mark |A!9] The proof follows by accordingly combining 
Corollary IV. 8 1 and the rate constraints which arise from 
the decodings in Carleial's variation of the Cover-Leung 
scheme. Again, a genie-aided argument is used in the 
analysis. The details are omitted. ■ 

Remark V.12. In the case of perfect partial feedback, 
for all channel parameters Pi,P2,N > 0, the achiev- 
able regions by Carleial ^]/ and Willems et al. [23^ 
(Appendices ^ and \B} correspond to the Cover-Leung 
region TZc-l{Pi, P2, N) (see, e.g., the explanation in ^ 
Section ITC]). Since irrespective of Pi, P2, N > 0, the 
Cover-Leung region is contained in the two achievable 
regions in Propositions \V.10\ and \VJT\ we conclude that 
Propositions \V.10\ and \V.11\ include also Carleial 's and 
Willems et al.'s regions for perfect partial feedback. 



B. Simple Scheme 

If in the simple scheme for noisy feedback in Sec- 
tion IIV-BI the parameter hi is restricted to be 0, then 
the scheme applies also to noisy partial feedback. In 
particular, in this case it achieves all nonnegative rate 
pairs {Ri,R2) that satisfy 

Pi < i log 
P2 < - log I 1 





1 '^la 






N 








«li 


1 2,2 






N 












a?.2 + 


^\.2 




TV 







Pi + P2 < - log 1 



(ai.ia2,2 - a2,iQi,2) \ 

for some choice of parameters ai,i, fli.2i ^2,17 '3;2.2i ^2 
satisfying 



and 



<2Pi, 



(02,2 - h2a2.if + hl(a\ i + iV + cr^) < 2P2 



The simple scheme for noisy partial feedback is in- 
cluded as a special case in the concatenated scheme for 
noisy partial feedback described in the next-following 
section. However, the simple scheme suffices to prove 
Corollaries ES] and EH and Theorem lY9l 



C. Concatenated Scheme 

1) Scheme: If in the concatenated scheme for noisy 
feedback in Section ITV-C 1 1 the parameter Bi is restricted 
to be the all-zero matrix, then this scheme applies also 
to noisy partial feedback. In this case, applying the inner 
encoders with parameters 77, ai,a2,Bi = 0, B2, and D 
induces a "new" MAC ^1, C2 ^ (2i, S2) of channel law 



(97) 



"1\ _ A Kl 

V=2/ \^2 

where the 2x2 matrix Ap is given by 

Ap = D(l„ - B2)"'A,-; (98) 

where Ar is defined as in (fTTT i: and where the noise vector 
Tp is a zero-mean bivariate Gaussian 

-1 



Tp = D (l,„ - B2) (B2W2 + Z) 
Defining the 2 x 77 matrix 
C 



(99) 



-p = D (I,, - D2 



the channel matrix in 
can be expressed as 

Ap = CpA,-, 

Tp = Cp (B2W2 + Z) 



B2) .. (100) 
and the noise vector in 



(101) 
(102) 
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-Rl,ICS < ^ log 



^2, ICS < ^ log 



-Ri.ics + -R2,ics < ^ log 



-Rl,ICL,l < ^ log 



^l.ICLJ < ^ log 



^2,ICL,1 < ^ log 



^1,ICL,1 + ^2,ICL,1 < ^ log 



i?l,ICL,2 < ^ log 



^1,ICL.2 < ^ log 



-R2,ICL,2 < ^ log 



-Rl,ICL,2 + -R2,ICL,2 < ^ log 



2(A - A'] 
iV 

N 

Pi - P[ + P2-P!, 
N 

{^-pi)Pi 





N2\ 


)+|log(n 






" N I 



Pi 


+ N 


(1- 


pl)Pi 


Ni 


+ N 


(1- 


pDP!, 



Ni + N 



J log 



N,+N+{l-pl)Pi + {l-pl)P^ 



Ni+N 
{1-P\)P[ \ 



P. 



I N 



N 



1 P[+N 

{^~pl)Pi \ , 1 
N2 + N 

(1 - Pl)Pi 



log 1 



N2+N+{l-pl)Pi + {l-pl)P^ 



N2 + N 



P[ + P!, + 2^P[P!,pIpI 



N2+N 



(96a) 

(96b) 

(96c) 
(96d) 

(96e) 

(96f) 
(96g) 

(96h) 

(96i) 

(96j) 
(96k) 



For fixed r] and B2 the mapping ( llOOI l from D to 
Cp is one-to-one, and thus we can parameterize our 
concatenated scheme for noisy partial feedback by the 
parameters 77, ai . a2 , B2 , Cp. 

Specializing also the power constraints ( fT9] l to the 
choice Bi = and to noisy partial feedback we see 
that only parameters 77,ai,a2, and B2 satisfying (|93] | 
are allowed. 

2) Choice of Parameters: In the following we de- 
scribe guidelines on how to choose the parameters of 
the concatenated scheme for noisy partial feedback. 
The guidelines parallel the guidelines presented in Sec- 
tion |l^C2] for noisy feedback. Similarly, the proofs why 
some of these guidelines are optimal parallel those in 
Section IIV-C2I and are omitted. 

Let Pi,P2,N > Q, al > Q ht given, and for the 
purpose of description replace the symbols ^1 and 1^2 
fed to the inner encoders by the independent standard 
Gaussians Si and S2. 

We start with the matrix Cp. Given parameters 
77, ai,a2,B2 the matrix Cp should be chosen as Cp = 



Cp,LMMSE, where 

Cp,LMMSE = (a,a; + N\^ + <jIB2^1] 



(103) 



The matrix Cp^mmse in ( 1103b is called the LMMSE- 
estimation matrix, since by ( |97] l, dlOlb . and (11021) . choos- 
ing Cp = Cp,LMMSE implies: 



Choosing Cp = Cplmmse is optimal in 
the sense that the corresponding region 
7?.pf(T|,7V;ry,ai,a2,B2,Cp,LMMSE) contains all regions 
72.p (fil, A^; ai, a2, B2, Cp) corresponding to other 
choices of the parameter Cp. Choosing Cp = UCp,lmmse 
for some non-singular 2-by-2 matrix U is also optimal, 
and for 77 = 2 choosing Cp as any non-singular matrix 
is optimal. 

We next consider the choice of the parameters 
ai; a2, B2, and first focus on the special case of perfect 
partial feedback. For perfect partial feedback the param- 
eters ai , a2 , B2 should be chosen so that the inputs pro- 
duced by Inner Encoder 2 correspond to scaled versions 
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of the LMMSE-estimation errors of S2 when observing 
the past feedback outputs. Thus, for ^ G {1, . . . , n}, they 
should satisfy 



X2,i = 7r2,i (S2-E[S2|Yl,...,r,-l]). 



(104) 



for some real numbers 7r2.i, . . . , TT2.ri- Otherwise there 
exists a choice of parameters satisfying ( 1104b that — 
with an appropriate choice of the matrix Cp — strictly 
improves on the original choice, i.e., corresponds to a 
larger region than the original choice. 

A similar choice for noisy partial feedback is not 
optimal, and it seems analytically infeasible to determine 
the optimal choice of the parameters ai, 32,61,62. 
However, it is easily seen that for noisy partial feedback 
the parameters ai.a2, 61, 62 should be chosen so that 
both power constraints ( |93a| ) and ( |93bt are satisfied with 
equality; otherwise there exists a choice of parameters 
satisfying ( I93al ) and ( I93bl ) that strictly improves on the 
original choice. 

In Remark |A. 91 we present for every 77 G N a specific 
(suboptimal) choice of the parameters ai, 32,62, and 
Cp. For this specific choice, the parameter Cp is the 
LMMSE-estimation matrix, the parameters 77, ai, a2, 62 
satisfy the power constraints ( |93a| ) and ( |93b| ) with equal- 
ity, and when specialized to perfect partial feedback 
ai, 32,62 satisfy ( I45bl i. We present the corresponding 
achievable region for rj = 2 and equal powers, i.e.. 
Pi = P2 = P, in Corollary IV.5I and for rj = 2 and 
perfect partial feedback in Corollary IV.8I 



D. Extensions of Concatenated Scheme 

The schemes in Sections IIV-DI apply also to noisy 
partial feedback, if the parameter 61 is restricted to 
be the all-zero matrix, and if Carleial's variation of 
the Cover-Leung scheme is specialized to noisy partial 
feedback. For more details see Sections IHll and |TT] 

E. Proofs 

1) Proof of Theorem \IV. 71 To prove Part 2) we distin- 
guish between the case of equal powers and of unequal 
powers. In the case of equal powers. Pi — P2 = P, 
we consider the achievable region in Corollary IV.51 and 
notice that, irrespective of P, iV > and (t| > 0, the 



RHS of the sum-rate constraint ( |94c| i is smaller than the 
sum of the RHSs of the single-rate constraints ( |94a| i and 
(I94bl ). Thus, for equal powers the achievable region in 
Corollary IV.5I is a pentagon (and not a rectangle) and 
there exist achievable pairs (i?i,i?2) of sum-rate equal 
to the RHS of ( |94c| l, which is larger than i log (l + ^) . 
This concludes the proof in the case of equal powers. 

To prove Part 2) in the case of unequal powers. Pi ^ 
P2, we use the following rate-splitting/time-sharing strat- 
egy. We assume Pi > P2', the case Pi < P2 can anal- 
ogously be treated. Transmitter 1 splits its message Mi 
into two independent submessages: submessage Mi 1 of 



rate i?i_i and submessage Afi 2 of rate Ri,2- During 
a fraction of time p|~p^ Transmitter 1 sends Message 
A/12 using an optimal no-feedback scheme of power 
(Pi + P2) while Transmitter 2 is quiet. During the re- 
maining fraction of time Transmitters 1 and 2 use 
equal powers 2 to send messages Mi i and A/2 with 
the concatenated scheme in Section IIV-CII Choosing 
the parameters of the concatenated scheme as proposed 
in Remark IA.9I by Corollary IV. 5 1 (where we replace P 



by -^^3^) and by the capacity of a AWGN single-user 
channel, the described rate-splitting/time-sharing scheme 
achieves the rate pair (Pi = Ri i + Pi,2,P2) where 
^1,1 1 Ri,2, and P2 are given by Equations ( 11051 ) on top 
of this page. The proof of ( |95l ) follows then by noting 
that for every Pi , P2 , iV > and every ct| > the rate 
pair (Pi, P2) has a sum-rate which is strictly larger than 
i log (1 + ^-^^^), and therefore lies strictly outside the 
no-feedback capacity region Cnofb(-Pii -P2: -^)- 

2) Proof of Theorem \V.9\ We consider an AWGN 
MAC with powers Pi = 1 , P2 = 5, noise variance 
N = 5, and with perfect partial feedback. We prove 
the theorem by showing that for this channel the rate 
point (Pi, P2), 




— which by Corollarv lV.Sl is achievable — lies outside the 
Cover-Leung region TZcl{Pi, P2, N). This implies that 
the capacity region CperfectPaniaiFB (A , -P2 , -/V) is strictly 
larger than the Cover- Leung region TZcl{Pi, P2,N) for 
Pi = 1 and P2 = = 5 . 

Before starting with the proof, we have a closer look 
at the region TZcl{Pi, P2, N) and show the following 
lemma. 

Lemma V.13. For Pi,P2,N > and for every pi € 
[0, 1) which satisfies 



P2 > pI 



N - I-pV 
the rate point {Ri{pi), R2{pi)) given by 



(106) 



(107) 



and by Equation dlOSb on top of the next page, lies on 
the boundary of TZchiPi, P2, N) in the sense that for 
every e > 

(Pi(pi),P2(pi) + e) ^ ncL{PuP2,N). 

Proof: As a first step we examine Expression ( 11081 ) 
and characterize P2 (pi ) more explicitly. To this end, we 
consider a fixed pi e [0, 1] that satisfies ( IIO6I 1. Then, we 
notice that in the minimization in ( 1108b the first term 
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^1,1 = 
R2 = Rl,2 = 



P1+P2 



2(Pi + P2) 

P2 

2(Pi + P2) 

+ 

2(Pi+P2: 



(105a) 



loa- 1 



log 1 



TV 



- 1 



(Pi +P2 + N) 



' P1+P2 
2 



)(^^) 



(Pi + P2 + Ar)2 (^±^ + AT + ^1 + 



2N "2) 



{Pi + P2 + N + a^] 



(Pi+P2 + 7V + ai + £^a|) 



(105b) 



P2(pi) max < mill < - log 1 
P2e[o,i] 2 \ 



P2{i-pD 

N 



Pi + P2 + 2vT\7^pip2 + N 



Pi{^-pI) 



N 



(108) 



is strictly decreasing in p2 G [0, 1] whereas the second 
term is strictly increasing in p2. Also, for = 1 the 
first term in the maximization in (1108b is smaller than 
the second term, whereas by Condition (IIO6I 1 for p2 = 
the second term is smaller Thus, for fixed pi G [0, 1] 
satisfying (IIO6I 1 the maximum in (IIO8I 1 is achieved when 
both terms are equal, i.e., for p2 given by the unique 
solution in [0,1] to 



^1 f P1+P2 + 2y/I\P2pip2 + N 

" 2 Pi (1 ^pD + N 

This implies that the rate pair {Ri{pi), R2{pi)) sat- 
isfies all three rate constraints defining the rectangle 



n. 



(Pl,P2) 



CL 



{Pi,P2,N) with equality, i.e.. 



RiiPi) 




(109a) 



(109b) 



and 



Riipi) + R2{pi) 



1, , Pi + P2 + 2vmpiP2 \ 



Hence, {Ri{pi), R2{pi)) is the dominant corner point 
of the rectangle 7^^'^'''''^(Pl, P2, iV), and for all e > 
the rate point {Ri{pi), R2{pi) + e) lies outside the 
rate region Tz\^'^'^^\Pi,P2,N). In the remaining we 
show that the rate point (Pi (pi), ^2(^1)) also lies 



outside the regions n\!^^''''''\Pi,P2,N) for all p'^.p'^ e 
[0, 1] not equal to the pair {pi,p2), and therefore also 
(Pi(pi), P2(pi) + e) lies outside these regions for every 
e > 0. This will then conclude the proof of the lemma. 
We distinguish the following three cases: 1) Pi > pi and 
p'2 arbitrary; 2) p'^ < pi and p'2 > p2', and 3) p'l < pi and 
P2 < P2- In case 1) the rate point (Pi(pi), ^2(^1)) lies 
outside the region nc^'^'^\Pi, P2, N) because Pi(pi) 
violates the single-rate constraint, see dlOab and (|109ab . 
Similarly, in case 2) the rate point lies outside the 
region TZ'^^'^^\Pi, P2, N) because in this case R2{pi) 
violates the single-rate constraint, see jlObb and ( |109bb . 
Finally, in case 3) the rate point lies outside the region 
-^(Pi ,P2) ^p^ , P2 , iV) because the product p[ ■ p'2 is strictly 
smaller than the product pi ■ p2, and thus the sum 
Ri{pi) + R2{pi) violates the sum-rate constraint, see 
( fTUcl ) and ( fTUfel l. ■ 
We are now ready to prove that the achievable 
rate point (Pi,P2) lies outside the Cover-Leung re- 
gion TZcl{Pi, P2, N). To this end, we choose pi = 
VD — VSS and notice that it satisfies Condition ( 1106b 
for P2 = iV = 5. Hence, Lemma IV. 131 applies and the 
rate point (Pf ,Pf ), 




Pf ^ max <^ min <^ - log (l + (l - pj)) , 

P26[0,l] Z 



1 / 11 + 2^5(6 - V35)p2 

2^°M 71 



(110) 
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lies on the boundary of the Cover-Leung region 
Ti-CL{Pi, P2, N), and in particular for every e > the 
rate point {RfjR^ + e) lies strictly outside the Cover- 
Leung region TZcl{Pi, P2, N). Since 

i?f = Ri, 

in order to show that the rate point (^1, ^2) lies strictly 
outside TIcl{Pi , P2 , N) it suffices to show that 



i?2 < i?2- 



(111) 



To prove ( 111 II ) we could compute p2 — the value of 
P2 which maximizes dl lOl l — and i?f and then check 
Condition ( II 1 II ). However, it is easier — and sufficient — 
to show that for all p2 E [0, 1] either 



N 



2 

< i?2 



(112) 



or 




<i?2. (113) 

To this end, note first that the LHS of dl 121) is decreasing 

in p2 G [0, 1], and therefore for all < /O2 < 1 it 
follows that 

ilog(2-p2)< liogYs + ^ + l") <i?2. 



On the other hand, the LHS of ( II 131 ) is increasing in p2, 
and thus for all < P2 < \/ j 




< R2, 

where the inequality follows because 

1 22 r ^ 12 

T7T + 6 - V35 + — - 2 „ ^ 

10 7 V7 

This concludes the proof of the theorem. 



< 



VI. Noisy Feedback with Receiver 
Side-Information 

For the setup with receiver side-information we 
present a new achievable region (Section IVI-Al i and a 
scheme that achieves this region (Section IVI-Bl i. The 
proposed scheme is an extension of the concatenated 
scheme for noisy feedback in Section IIV-CI and ex- 
ploits the side-information at the receiver The simple 
scheme (Section [IV-BI ) and the extended schemes (Sec- 
tions lIV-DI i can be analogously extended to this setup 
with receiver side-information. For brevity, we omit the 
description of these latter extensions. 

A. Results 

Definition VI.l. Let t] be a positive integer;a.i,a.2 
be rj-dimensional vectors; 61,62 be strictly lower- 
triangular rj X rj matrices; and Csi be a 2 x rj ma- 
trix. Depending on the matrix Csi the rate region 
TZsi {N, KwiW2 ; 3-1, 3-2, 61, 62, Csi) is defined as fol- 
lows: 

• If the product CsiCgj is nonsingulai^ then 
TZsi (iV, cr|; 77, ai, a2, 62, Csi) w defined as the set 
of all rate pairs (i?i,i?2) satisfying 



Ri<7r log 



1 |Csi(aial+jVI,)C^sil 
277 ^ A^ICsiC^sJ 



, (114a) 



1 |Csi(a2a5 + A^I„)C^,| 

2r/ iV|CsiCJi| 

where A, is defined in dill ). 

• If Csi Csi is singular but Csi 7^ 0, then 
TZsi [N, (t|; rj, ai, a2, 62, Csi) w defined as the set 
of all rate pairs (_Ri, R2) satisfying dl 14l l when the 
2x7] matrix Csi is replaced by the rj-dimensional 
row-vector obtained by choosing one of the non- 
zero rows of Csi. 

• //Csi = 0, then 7^sI (A^, cr|; 77, ai, a2, 62, Csi) is 
defined as the set containing only the origin. 

(An alternative formulation of the region 

7?.si(^,KH/jvy2;r7,ai,a2,6i,62,Csi) is presented 
in Section! 



Definition VI.2. Define the region 
nsv{Pi,P2.N,Kw,W2) 

= cl (|J7^sI (iV,KH'iW2;??,ai,a2,6i,e2,Csi)) , (115) 

where the union is over all tuples [rj, ai, a2, 61, 62, Csi) 
satisfying the trace constraints il9i . 

Tlieorem VI.3 (Noisy Feedback with Receiver 
Side-Information). The capacity region 

'^Whenever »j g N is larger than 1, there is no loss in optimahty in 
restricting attention to matiices Csi so that CsiCgj is nonsingular. 
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CNoisyFBSi(-Pi, ^2, ^, Kvi/iWa) of ^^'^^ two-user AWGN 
MAC with noisy feedback where the receiver is cognizant 
of the realization of the feedback-noise sequences 
contains the rate region TZsi {P11P2, N, KW1W2)' '•^•> 

CNoisyFBSI {Pi , P2, N , KW1W2 ) 

D7^SI {PuP2,N,Kw^W2)- 

Proof: The achievability resuh is based on the 
concatenated scheme in Section IVI-Bll It is obtained 
from Theorem IIV.3I by setting ct^ = ct| = in the 
rate expressions in ( fTSl ) (but not in the power constraints 
(fT9]l). The reason why in ( fTsT i we may set crj = (Tj — 
is because in the scheme in Section IVI-Bll prior to 
the decoding, the receiver subtracts off the influence of 
the feedback-noise sequences {W^i.t} and {14^2, t}- The 
details of the proof are omitted. ■ 

Remark VI.4. Evaluating the achievable region 
Ti-si{Pi, P2t N,Kw-^W2) seems to be difficult even nu- 
merically. More easily computable (but possibly smaller) 
achievable regions are obtained by taking the union on 
the RHS of ( fTTSl l only over a subset of the parameters 
ry, ai, a2, Bi, B2, Csi satisfying In Section \G1\ we 
present such a subset of parameters and its correspond- 
ing achievable region ( Corollarv \A.16\l . In Section Wl-B2\ 
ahead we present more general guidelines on how to 
choose the parameters 77, ai, a2, Bi, B2, Csi for noisy 
feedback with receiver side-information. 

B. Concatenated Scheme 

1) Scheme: In this section we extend our concate- 
nated scheme to noisy feedback with receiver side- 
information. We use the same outer code and the same 
inner encoders as in the setting without side-information. 
The difference is only in the inner decoder. Thus, when 
fed the pair of symbols (^1,^2), the inner encoders 
produce, as before, sequences of channel inputs 



^^£{1,2}, 



(116) 



where X,, ^ {X^^i, . . . ,X^^jjy, Y^, = 
(V^ i, . . . , VJy.,,-i)^, and where ai, a2 are ?7-dimensional 
vectors and Bi,B2 are strictly lower-triangular 77 x 77 
matrices satisfying the power constraints iT% . But, we 
modify the structure of the inner decoder so that it 
computes the estimates (Si,S2) not only as a function 
of the output sequence but also of the feedback-noise 
sequences. Again, we choose a linear mapping, i.e., 
for Y 4 (Y,, . . .,Y^y, W, ^ {Wi.i, Wi,^y, and 
W2 = (W2,i, • ■ • , 1^2. jj)^, the inner decoder computes 



DoY + DiWi + D2W^2 



for 2x7/ matrices Do,Di,D2 of our choice. Given 
ai , a2 , Bi , B2 , and Dq an optimal choice for the matrices 
Di and D2 subtracts off the contributions to DqY that 



come about from the feedback-noise sequences, i.e., an 
optimal choice of Di and D2 satisfies 

Di = -Do(l^-(Bi + B2))-iBi, (117a) 
D2--Do(l^-(Bi + B2))-iB2. (117b) 

Such a choice leads to the following description of the 
"new" MAC ^ {^1,^2) ■ 



^1 



(lis) 



where the 2x2 matrix A is given by 

Asi = Do(I„-(Bi + B2))^'A„ (119) 

where Ar is defined as in (fTTT ). and where the noise vector 
T is a zero-mean bivariate Gaussian 



Tsi-Do(l,-(Bi + B2))"'Z. 



(120) 



In the following we shaU always assume that Di and D2 
are optimally chosen so that the "new" MAC is given 
by ( I118b -( fn0b . We define the 2 x 77 matrix 

Csi = Do(l^-(Bi + B2))-\ (121) 

and hence Asi in dl 19t and the noise vector Tsi in ( 11201 ) 
can be expressed as 



Asi = CsiAr, 
Tsi = CsiZ. 



(122) 
(123) 



For fixed 77,Bi,B2 the mapping ( 11211 ) from Dq, to 
Csi is one-to-one, and thus we can parameterize our 
concatenated scheme for noisy feedback with receiver 
side-information by 77, ai, a2, Bi, B2, Csi. 

All parameters 77, ai, a2, Bi, B2 that satisfy the power 
constraints ( fT9b are allowed. 

2) Choice of Parameters: As in the previously stud- 
ied setups we present guidelines on how to choose 
the parameters 77, ai, a2, Bi, B2, Csi of the concatenated 
scheme. The guidelines parallel the guidelines for noisy 
feedback and noisy partial feedback in Sections IIV-C2I 
and lV-C2l likewise, also the proofs of optimality parallel 
the proofs in Section IIV-C2I and are omitted. 

Let Pi,P2,N > and KwiW2 ^ be given, and 
for the purpose of describing our guidelines replace 
the symbols ^1,^2 fed to the inner encoders by the 
independent standard Gaussians Si,S2. 

We first present the optimal choice of the parameter 
Csi. Given 77, ai, a2, Bi, B2 the parameter Csi should be 
chosen as Csi = Csi.lmmse, where 



Csi,LMMSE = (ArA; + A^l^)" 



(124) 



since the corresponding achievable region contains all 
regions corresponding to other choices of the matrix Csi. 
The matrix Csi,lmmse is called the LMMSE-estimation 
matrix with side-information, since by ( II 181 ). ( 11221 ). and 
( |123l l the choice in ( 11241 ) — combined with the optimal 
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choices of Di and D2 defined by ( II 17l i and (1121b - 
implies that 



Obviously, also choosing Csi = UCsi,lmmse for some 
non-singular 2-by-2 matrix U is optimal, and for rj = 2 
choosing Csi as any non-singular matrix is optimal. 

We next consider the choice of parameters 
ai,a2, 61,62 and focus on the following two special 
cases: 

a) 77 e N is arbitrary and g — 1, i.e., the feedback 
noises are perfectly correlated, 

b) ?7 = 2 and g E [—1,1) arbitrary. 

In these cases, given parameter 77 e N, the parameters 
ai,a2,6i,62 should be chosen so that the inner en- 
coders produce 



(125a) 



and 



X2,t = n2,i (S2-E[S2|y2'"i]) 



£e{l,...,v}, 
(125b) 

for some real numbers tti.i, . . . , tti and 7r2,i, . . . , TT2,ri- 
Otherwise, there exists a choice of parameters 
r], ai, a2, 61, 62, Csi of the form ( 11251 ) that strictly im- 
proves on the original choice. 

In general, it seems difficult to determine the optimal 
choice of the parameters ai,a2,6i,62. However, it is 
easily proved that the parameters 77, ai, a2, 61, 62, Csi 
should be chosen so as to satisfy the power constraints 
( |19at and ( |19bt with equality; otherwise there exists a 
choice of parameters satisfying ( |19a| ) and ( |19b| ) with 
equality that strictly improves on the original choice. 

In Section |G] we present a specific choice of the 
parameters ai, a2, 61, 62, Csi that guarantees that Csi 
is the LMMSE-estimation matrix with side-information, 
the power constraints (1% are satisfied with equahty, 
and ?7, ai, a2, 61, 62 satisfy ( 11251 ) for all 77 € N and 
g e [—1,1]. We present the corresponding achievable 
region in Corollary IA.16I 

VII. Summary 

We have studied four different kinds of two-user 
AWGN MACs with imperfect feedback: 

• noisy feedback, where the feedback links to both 
transmitters are corrupted by AWGN; 

• noisy partial feedback, where one transmitter has 
noisy feedback and the other no feedback; 

• perfect partial feedback, where one transmitter has 
noise-free feedback and the other no feedback; and 

• noisy feedback with receiver side-information, 
where both transmitters have noisy feedback and 
the feedback-noise sequences are perfectly known 
to the receiver. 



For each of these settings we have presented a coding 
scheme (called concatenated scheme) with general pa- 
rameters, and we have stated the corresponding achiev- 
able regions (Theorem |IV.31 Theorem |V.31 Corollarv lV.7| 
and Theorem |VI.3l ). We have improved the concatenated 
scheme by rate-splitting it either with a simple no- 
feedback scheme or with Carleial's version of the Cover- 
Leung scheme. The achievable regions corresponding 
to these improvements are stated in Proposition IIV.13I 
(noisy feedback) and Propositions IV. 1 01 and IV. 1 1 1 (perfect 
partial feedback). 

The two achievable regions for noisy feedback in The- 
orem IIV.3I and Proposition |IV. 131 exhibit the following 
three properties: 1. They are monotonically decreasing in 
the feedback-noise covariance matrix with respect to the 
Loewner order (Propositions II V.5 1 and II V. 1 4l ) . 2. They are 
continuous in the transmit-powers (Propositions |IV.5| and 
|IV.14t . 3. They converge to Ozarow's perfect-feedback 
regions when the feedback noise-variances tend to 0, 
irrespective of the feedback-noise correlations (Propo- 
sitions |IVl and |IVl6|. 

We have further presented guidelines for choos- 
ing the parameters of our concatenated schemes (Sec- 
tions IIV-C2I IV^ and |VI-B2| i, and have suggested 
(suboptimal) specific choices of the parameters (Sections 
lEll IFll and IGlt . The achievable regions corresponding 
to these specific choices are presented in Corollary IIV.6I 
Corollary [V5] Corollary Corollary IaTTI Corol- 
lary [AH Remark lAl4l and CoroUarv lAl6l 

These achievable regions — combined with the previ- 
ously described properties of the achievable regions for 
noisy feedback in Theorem ll V. 3 1 and Proposition II V. 1 31 — 
allowed us to infer: 

1) Feedback — no matter how noisy — is strictly better 
than no feedback. I.e., irrespective of the feedback- 
noise variances, the capacity region with one or two 
noisy feedback links is strictly larger than the no- 
feedback capacity region (Theorems IIV.7I and I V.6I 1. 

2) The noisy-feedback capacity region converges 
to the perfect-feedback capacity region as the 
feedback-noise variances on both links tend to 
— irrespective of the feedback-noise correlations 
(Theorem |IVI3. 

3) The Cover-Leung region in general does not equal 
capacity for perfect partial feedback channels (The- 
orem |V9]). This answers in the negative a question 
posed by van der Meulen in ifTSl . 
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Appendix 

A. Carleial's region 

Carleial proved the achievability result for the AWGN 
MAC with noisy feedback in Theorem IA.2I ahead |l2l. 
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Definition A.l. Define the rate region 
TZcax{Pi,P2,N,ai,a2) as the set of all rate pairs 
(i?i,i?2) which for some nonnegative numbers 
■Ri, 0)^1,1 summing to Ri, for some nonnegative 
numbers i?2,o 1^2,2 summing to R2, and for some 
choice of parameters ai, 02, /32, A £ [0,1] satisfy 
the 13 conditions ( 11261) shown on top of the next page, 
where for x £ [0, 1] we define x = [1 — x). 

Tlieorem A.2 (Carleial f2]). Consider an AWGN 
MAC with noisy feedback of transmit powers Pi,P2, 



matrix K 



noise variance N, and feedback-noise covariance 

( af ga-ia2\ , 
W,W'? = [ 2 • Irrespective 

\ga1a2 cri J 

of the noise correlation g e [—1,1], the region 
TZAch{Pi, P2, N,cri,a2) is achievable for this channel, 



T^Ach {Pi, P2, N,al,a2) C CNoisyFB {Pi , P2 , N , KW1W2) ■ 

Lemma A.3. The rate region T^car (^'i, ^2, o-^, cr|) 
collapses to the no-feedback capacity region 
CnoFB (^'i 7 P2 , N) when the feedback-noise variances 
, (72 exceed a certain threshold depending on the 
parameters Pi,P2, and N. In particular, 

7^Car(Pl, P2, N, a\,al) = CnoFb(Pi, P2, iV), 

for a\ > Pi (I + f ) and al > P2 (| + f )■ 

Proof: For all values of (yf,<T2 the region 
'7?-Cai(Pi, -P2, A^, cTi, cr|) trivially contains the no- 
feedback capacity region CnoFb(Pi, P2, N) because the 
region obtained by substituting ai ~ a2 ~ I3i — (32 ~ ^ 
into ( II26I 1 coincides with CnoFb(Pi, P2, -^)- Thus, 
it remains to prove that TZcm{Pi , P2 , N , al , a^) is 
included in CnoFb(Pi, P2, for all ai,a2 exceeding 
some threshold depending on Pi, P2, and N. 

To this end, we choose , cr| > and we fix a rate 
pair (i?i,i?2) in TZcaiiPi, P2, N, af, a^). We then fix 
parameters ai, a2, /?i, /?2, A G [0,1], two nonnegative 
numbers i?i.o and i?i 1 summing to and two non- 
negative numbers R2.0 and i?2.2 summing to R2 so that 
Constraints ( I126l l are satisfied. We show in the following 
that if cr J, (t| > are sufficiently large, then (i?i,i?2) 
lies in CnoFb(Pi,-^^). 

By ( I126al ) and ( I126cl l the rate Ri satisfies 

Ri < laiPiPiaiPiPi +N + al 
+lai(3iPiN 

< IPiN, (127) 

and by ( I126bl i and ( I126dl ) the rate R2 satisfies 

i?2 < la2p2P2a2l32P2 + N + af 
+la2f32P2N 

< IPiN, (128) 



Furthermore, by ( I126al i. ( I126bl i. and ( I126hl ) the sum 
of the rates i?i + R2 satisfies Inequality ( I129l l on the 



next page. Notice that for (T^,(t| larger than some 
threshold depending on Pi , P2 , N — and in particular for 
CT? > Pi (I + -^) and erf > P2 (I + -^)— irrespective 
of the chosen parameters ai,a2, (3i, ^2, A: 

N + ai/3iPi + a2^2P2 



< 1 (130) 



< 1.(131) 



ai/3iPi +N + a^ 

{aiPiPi + \N){a2hP2) 
^ (a2/32P2 + N + crl){aiPiPi + N + a^) 

and 

N + aiPiPi + a2li2P2 
a2hP2 +N + al 

(«2/32P2 + ^A^)(ai/3iPi) 
^ (ai/3iPi +N + al){a2p2P2 + N + al) 

Thus, when a\ , cr| exceed a certain threshold depending 
on Pi, P2, and N, the RHS of ( fT29b is upper bounded 
by i log (1 + -EiiS.). We conclude that when a^aj 
are sufficiently large, then by ( |127| l-( fT3T] ) the rate pair 
(Pi,P2) satisfies (|5]l and hence lies in the no-feedback 
capacity region Cnofb(Pi, P2, This concludes the 
proof. ■ 

B. Willems et al.'s region 

Willems et al. proved an achievability result for the 
discrete memoryless MAC with imperfect feedback fT^. 
The result can easily be extended to the two-user AWGN 
MAC with noisy feedback (Theorem IA.5I ahead). 

Definition A.4. Define the rate region 
7?.wii(Pi, P2, A^j fi, (t|) as the set of all rate pairs 
{Ri,R2) which for some nonnegative numbers Ri^i 
and R12 summing to Ri, for some nonnegative 
numbers ^2,1 ond i?2,2 summing to R2, and for some 
parameters 61,82, Pi,P2 G [0,1] satisfy the following 
five constraints: 



Ri.i < ^log 



1 



R 



1,0 



< 2log( 1 



5iPi 
N 

~5iPi{l 



bxPx^N + ai 



i?2o<iiogri+i^^ii^ 

''°-2 52P2+iV + CT? 



R2,2 < ^ log ( 1 
i?l^l + P2,2 

< ^log( 1 

^1 + R2 



62P2 

N 



SiPi + 152P2 
TV 



^1, / Pi + P2 + 2v/^i^2PlP2PlP2 \ 

- 2 °^ N J ' 

Tlieorem A.5 (Willems et al. EH). Consider an AWGN 
MAC with noisy feedback of transmit powers Pi , P2, 
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i?i,o <boJl+ ,ff' (126a) 

^2.0 <|log(l+ ,l'^f' (126b) 
1 / aiBiPA 

Ri,i -2°^(^'^^P)' ^^^^''^ 

Ri.Q + R20 < 2 log ( 1 + j + ^"1^1 + "2P2 + 2v/aia2PiP2A^ + aiPi + 03^2 (126e) 

Ri.o + R2,2 < laiPiPi + a2f32P2N + IX (aiPi + a2P2 + 2^/a^^^^P[P^^ N + a^Pi + azPz (126f) 

i?2,o + RiA < laiPiPi + a2P2P2N + l\ [ctiPi + 0:2^2 + 21/0102^1^2) + aiPi + ^2^2 (126g) 

Pi,i + P2.2 < laiPiPi + a2l32P2N (126h) 

Ri+R2,o < laiPi + a2l32P2N + laiPi + a2P2 + 2y^a^^^P[l^N + aiPi + a2P2 (126i) 

Ri,o + R2 < laii3iPi + a2P2N + laiPi + a2P2 + '2\/^^i^^P[l^N + aiPi + a2P2 (126j) 

R1+R2.2 <laiPi+a2P2P2N + lx(^aiPi+a2P2 + 2y^5^^^^P[P2^N + aiPi+a2P2 (126k) 

R1.1+R2 < laiPiPi + 02^2 + ;A (aiPi + a2P2 + 2^0102^1^2) + "iPi + 02^2 (1261) 

Pi + P2 < ^Pi + P2 + 2Vai02PiP2Af (126m) 



Pi 



i?2 < i log ( 1 



aiPiPi 



aii3iPi+N- 
+laif3iPi + a2P2P2N 



^ 1 , I ^ Oi/3iPi + 02/32^2 



2log(l 



a2/?2-P2 



"2/32 P2 + A" + erf 



+ 



+ 



aiftPi / + ai/3iPi + 02^2^2 
1^ oi/3iPi +iV + f7| 

a2hP2 ( N + aiPiPi + 02/32P2 

iV I O2/32P2 + iV + 



(oi/3iPi + \N) 



a2/32-P2 



ai/3iPi + iV + cr^ 
(a2/?2P2 + iA^) ,^,r^f|^^,2 

a2/32P2 + iV + cr? 



(129) 



nowe variance N, and feedback-noise covariance ma- 

■ ,y ( Q<J\a2\ . . r J 

trix Kw, Wo = 9 ■ Irrespective of the 

^'^^'^ \Qa1a2 <ji J 

feedback-noise correlation g G [—1,1], the region 
'R-wniPi , P2 , N , , a2) is achievable for this channel, 
i.e., 

'Rwil{Pl,P2,N, 0-^,0-2) ^ CNoisyFB (Pi , P2 , Af, Kyv^i^^J. 

Lemma A.6. The rate region 7?.wii(Pi, P2, A^, cr^, ctI) 
collapses to the no-feedback capacity region 
CnoFB (-Pi j P2 , A^) when the feedback-noise variances 
CTi , (t| exceed a certain threshold depending on the 
parameters Pi,P2, and N. In particular, 

nMPi,P2,N, alai) - Cnofb(Pi, P2, 



for a\ > Pi (i + f ) and gI > P2 (| + . 

Proof. Follows along similar lines as the proof of 
Lemma IA3] in the previous appendix, and is omitted. ■ 

C. Optimality of LMMSE-Estimation Error Parameters 
for Perfect Feedback 

We show that in our concatenated scheme for per- 
fect feedback it is optimal to choose the parameters 
?7, ai, a2, Bi, B2 so that the two inner encoders pro- 
duce as their ^-th channel inputs scaled versions of 
the LMMSE-estimation errors when estimating the fed 
symbols Si and S2 based on the previous outputs 
Yi,...,r,_i, see (US. 



33 



Proposition A.7. Assume that KwiW2 — 0> '•^•> perfect 
feedback. If the parameters 77, ai, a2, Bi, B2, C satisfy 
the power constraints (|19l l but not Conditions ( |45t , then 
there exist parameters 77, aj, aj, BJ, Bj, C* satisfying 
both ( fT9] l and ( |45] l, ami 

7^(7V,0;77,al,a2,Bl,B2,C) 

C7^(iV,0;^7,a^a*,B^B;,C) 

wiY/i f/ie inclusion being strict. 

The proof is given after the following lemma. 

Lemma A.8. As sume that ^\y^\Y2 — 0> i.e., assume 
perfect feedback. If the parameters 77, a'j^, a2, B'j^, Bj, C 
satisfy (|19l l but violate i45\ then there exist parameters 
77, ai, a2, Bi, B2, C satisfying the following three condi- 
tions: 

1) the parameters 77, ai, 3.2, Bi, B2, C satisfy i45\ : 

2) 7^(7V,0;77,a'l,a^,B'l,B^,C') 

= 7^(7V,0;77,al,a2,Bl,B2,c),• 

3) the parameters 77, ai, a2, Bi, B2, C satisfy il9a\ 
and ( |19b| l, and at least one of them with strict 
inequality. 

Proof: Fix parameters rj, a.[,a'2,B'i,B'2,C' satisfy- 
ing fT% but violating ( l45T l. Define the following new 
parameters. 

• Let ai = &[ and a2 = 33. 

• Let Bi and B2 be so that ai,a2,Bi,B2 satisfy 
i45[ . (Notice that given the parameters ai and 3.2 
there exists exactly one choice of the parameters Bi 
and B2 satisfying ( |45] ). I.e., the scaling coefficients 
{""i.^lf^i and {TT2,e}J^i in ( |45] ) are determined by 
ai and a2.) 

. Let C = C. 
By construction, our choice ai, a2, Bij B2, C 
trivially satisfies Condition [T] in the lemma. 
Moreover, since for K^^^^j — the region 
7?. (A'', 0; 77, ai, a2, Bi, B2, C) depends only on ai,a2, 
and C but not on Bi and B2, see Definition II V. 1 [ 
the regions 7^ (iV, 0; 77, a'^, a^, B'^, B^, C) and 
77,ai,a2, Bi, §2, coincide. Thus also 
Condition I2] is satisfied. 

We are left with proving that the parameters 
ai, 3.2, Bi, B2, C satisfy also Condition [3] Before doing 
so, we introduce some helpful assumptions and notation. 
Assume in the following that Inner Encoder 1 and Inner 
Encoder 2 are fed the independent standard Gaussians Si 
and S2, respectively. Let Y(, . . . , denote the 77 chan- 
nel outputs of the original MAC xi,X2 Y when the 
inner encoders use the parameters 7;, a'^, aj, B'^, B2, C, 
and similarly, let Yi , . . . , 1^ denote the rj channel outputs 
of the original MAC xi,X2 Y when the inner 
encoders use the parameters 7;, ai, 3.2, Bi, B2, C. Also, 
let a'^ a2 £, ai,£, and 0,2, f denote the ^-th entry of 
the vectors a'^, 32,3.1, and 3.2, respectively, and let 



b[ g J, b'2 £ p ^i.e.j^ and b2,e,j denote the iow-£ column-j 
entry of the matrices B'j^,B2,Bi, and B2, respectively, 
for jjG {1, ... ,77} and € {1,2}. 

Fix an £ e {1, . . . , 7;}. By the definition of LMMSE- 
estimation errors, for all 7/ e {1,2} and all real numbers 



Var d^^e^i, - ^ b^,i,jYj 



> Var I^VfS, - J2 ^b-AjYjj - (132) 

with equality if, and only if, b,yjj = bu,i,j for all 
i e {1, 1}. We would like to prove a similar 

inequality to ( I132l i but where in the RHS of ( 11321 ) 
the outputs {li, . . . , Yf-i} are replaced by the outputs 
{Y{, . . . , l7_i}. To this end, we notice that since ai = 
a'l and a2 — 33 there exist real numbers {bi^ijYj=i and 
{b2,ej}^=l such that 

e-i \ / i-i 

T'vd'^v - ^ b^^ijYj j = I a'j, - ^ K,e,jYj 
i=i / \ j=i 

with probability 1. Combining this observation with 
Inequality ( 11321 ) the desired inequality follows: 



> Var I a^,^^;. - K,e,jYj 



(133) 



with equality if, and only if. 



Y, 



(134) 

with probability 1. By (11331 ) and since the parameters 
77, a'l, 32, B'l, B2 satisfy the power constraints ( fT9] l, it fur- 
ther follows that also the parameters 77, ai , a2, Bi , B2 sat- 
isfy Constraints ( fT9l ). Moreover, since the pairs (B'j^, Bj) 
and (61,62) differ, not for all i e {1,...,7;} and 
all u G {1,2} equaUty ( 11341 ) can hold and thus the 
parameters 7/, ai, 3.2, 61, 62 satisfy either ( |19at or ( |19b| ) 
with strict inequality. This concludes the proof of the 
lemma. ■ 
Proof of Proposition IA.71 The proof uses 
Lemma [A. 81 twice. Fix parameters 77,31,32,61,62,0 
satisfying ( fT9l l but violating (l45l l. By Lemma lA.81 there 
exist parameters 77, ai, 32, 61, 62, C that satisfy (05]) and 

TZ (N, KW1W2; 111^11^2, 61, 62, C) 

^n(^N,KwiW2]V,^i,^2,Bi,B2,Cj , (135) 
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and that satisfy ( |19a| ) and ( |19b| ). whereby one of 
them with strict inequahty. Further, since the pa- 
rameters ?7, ai, 3.2, Bi, B2, C satisfy either ( |19a| ) or 
il9H with strict inequality, there exist parameters 
77, ai, a2, Bi, B2, C that satisfy both ( |19a| ) and il9H with 
equahty (but not necessarily i45[ ) and that correspond 
to a strictly larger region (see Section llV-C2b . Thus, by 
(fT35] ) 

TZ {N, KwiW2 ; ?7, ai : a2, Bi , B2 , C) 

C n (N, Kw,W2 ; 77, ai , a2, Bi , B2, C) (136) 

with the inclusion being strict. 

Applying Lemma IA.8I again, this time to parame- 
ters J], ai, a2, Bi, B2, C, we conclude that there exists a 
choice of parameters 77, a^; , aj , B^ , Bj , C* satisfying both 
(O and and 

TZ (TV, Kvv'iH'^;??, ai,a2, 61,62, C) 

By ( 11361 ) this implies 

TZ{N, KwiW2;V,^i,^2, 61, B2,C) 

with the inclusion being strict, which concludes the 
proof. ■ 



D. Alternative Formulation of Achievable Regions 

We derive an alternative formulation of the 
region achieved by our concatenated scheme 
7?. (A^, Kvvjvy^ ; 77, ai, a2, 61, 62, C) when C is chosen 
as the LMMSE-estimation matrix Clmmse (as defined 
in (l43T l) and 77,31,32,61,62 are arbitrary. Recall that 
there is no loss in optimality in restricting attention 
to the choice C = Clmmse^ see Section IIV-C2I 
Similarly, we derive an alternative formulation for 
the achievable region 7?.p (A^, cr|; 7;, ai, 32, 62, Cp) 
when Cp — Cp^mmse (as defined in ( 1103b ). 
and an alternative formulation for the achievable 
region T^si {N, KwiW2;il, ai, a2, 6 1, 62, Csi) when 
Csi = Csi.LMMSE (as defined in (1124b ). These alternative 
formulations simplify the description of the achievable 
regions corresponding to our specific choices of 
parameters suggested in Appendices |E1 |F1 and |G1 
In particular, for perfect feedback the alternative 
formulation is useful to describe the achievable 
region corresponding to the choice of parameters 
in Appendix |Fl see Remark IA.14I The region in 
Remark |AjT4] is used in Section IIV-E2I to prove that our 
concatenated scheme for perfect feedback achieves all 
points in the interior of Ozarow's region TZq^{Pi, P2, N) 
(Proposition |IV.9b . 



1) Noisy Feedback: Given parameters 
77,31,32,61,62 and C = Clmmse, we 
derive an alternative formulation for the 
region achieved by our concatenated scheme 
Tl{N, KM/iW2;??,ai,32, 61, 62, C). 

To simplify notation, in this section we assume that 
Inner Encoder 1 and Inner Encoder 2 are fed independent 
zero-mean unit-variance Gaussian random variables and 
therefore we denote them by Si and S2 instead of ^1 
and ^2- The region achieved by our concatenated scheme 
can then be expressed as the set of all nonnegative rate 
pairs (i?i,i?2) satisfying 

i?i < -/(Si;Si,52|S2), (137a) 
V 

i?2 < -/(S2;Si,S2|Si), (137b) 
V 

i?i+i?2 < -/(Si,S2;Si,S2), (137c) 
77 

where the conditional law of (Si,S2) given Si = 
^1 and S2 — £,2 is determined by the channel law 
Ci,6 (Si,S2) in Equation ^ (Section HvCTT l. 
Notice that since C is the LMMSE-estimation matrix 
Clmmse in ( l43l l (Section IIV-C2b . by the Gaussianity of 
the involved random variables the rate constraints in 
(1137b are equivalent to: 

i?i < i/(Si;Yi,...,i;,|S2), (138a) 
77 

i?2 < -/(S2;Yi,...,i;,|Si), (138b) 
77 

i?i+i?2 < -/(Si,S2;ri,...,r„), (138c) 
V 

where Yi , . . . , are the 77 channel outputs produced 
by the original channel xi,X2 Y when the inner 
encoders are fed the independent standard Gaussians Si 
and S2. 

Denote for each channel use £ e {!,..., r/} the 
receiver's innovation by li, i.e., 

/, ^r,-E[y,|r^-i], (i39) 

and the receiver's LMMSE-estimation errors about the 
symbols Si and S2 by Ei^^ and £^2,^, i-e., 

£;i,, ^Si-E[Si|r^] , (140a) 
£;2,, ^S2-E[S2|H . (140b) 

Then, notice that there exists a bijective mapping be- 
tween the innovations Ji , . . . , and the channel outputs 
Yi,...,Y^, and by the Gaussianity of the involved 
random variables, for each £ G {!,..., 7;}, the tuple 
{Ei^i, E2.e, le) is independent of the previous outputs 
and innovations (Yi, . . . , Yf_i, /i, . . . , le-i). By the 
chain rule of mutual information we can therefore rewrite 
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Constraints ( 1138b as 

1 

i?i < - V/(Si;/,|S2), (141a) 
1 

i?2 < - V/(S2;/,|Si), (141b) 
1 

i?i+i?2< -V/(Si,S2;/,). (141c) 

In the following we give a more explicit description 
of the innovations {Ie}£^i in terms of the entries of 
the parameters ai, a2, Bi, B2. For each £ £ {1, . . . , 77}, 
let a^ i denote the £-th entry of the vector a^, and 
b,^,i,j denote the row-£ column-j entry of the matrix 
B^, for j,e £ {l,...,ry} and 1^ e {1,2}. Also, let 
ai^g = \lax{Ei,i) and a2,i = Var(£'2,£) denote the 
variances of Ei p and Eo i, and pp = Co\4gi,f ,^ 2^ ihtvc 
correlation coefficient. We can then write the innovations 
as 

/i = Yi = fli^Si + a2,iS2 + ^'i; (142a) 
and for I E {2, ■■■,'!]} as 

li — 0'i,iE\/^-i + a2jE2j~i 

= i^i.e-iEi^p-i + K2,£-iE2/^i 

+W^.i-i + Zp, (142b) 

where 

e-i e-i 
Wp-i ^ J2 ^i.^.J^iJ + J2 ^2,^jW^2j, (143) 

Vri,£-i = -E[Wp-i\Ei,e-i,E2,p-i,Y^-^] 

(144) 

= - E [iy,_i £;2,,_i, /^-i] , 

(145) 

and 

a2,e-iCoy[Eij_i,We-i] 



(1 - pj_i)oii,p^ia2,p-i 
Pi-iy/ai,p-ia2,i-iCoy[E2j-i, Wp-i] 



K2,e-i — a2. 



(1 - p'p-i)ai,e-ia2,e- 
n,e-iCoy[E2,e-i, Wp-i] 



(146) 



(1 - Pp_i)aij-ia2j-i 
-iy/ai,p-ia2,e^iCoy[Eij^i, Wp-i] 



(1 - Pi-i)ai,i-ia2,e- 



(147) 



Evaluating the mutual information expressions in ( I141l i 
for the innovations in ( I142l i. we conclude that our 
concatenated scheme for noisy feedback with parameters 
T], ai, a2, Bi, B2 and C = Clmmse achieves all rate pairs 
R2) satisfying Constraints ( |148t on the top of next 



page, where we defined ai q = 1, a2.o — 1, Po — 0, 
Ki.o = ai,i, K.2,0 = a2,i, W±fi = 0. 

We conclude this section with a recursive characteriza- 
tion of the variances {ai^p}^^-^ and {ct2,e}^=i, and the 
correlation coefficients {pe}^^i- Defining £'10 — Si, 
£'2,0 — S2, we find for £ g {1, . . . , r/}: 



Eie — El p^i 



E2I — E; 



Gov [£l. £-!,/£ 

Var(/,) 

C0V[E2,£-l,Ip 



h, (149a) 



(149b) 



Var(/,) 

and consequently, by (11421) the recursive expressions 
( I150b - (ll52b on top of the next page. 

This alternative formulation is used in Corollar- 
ies lA.llI and IA.13I in Appendices |E] and |F] ahead to de- 
scribe the regions achieved by our concatenated scheme 
for noisy feedback with the specific choices of parame- 
ters described in Sections lEll and [FT] In particular, it is 
used to describe the region achieved in the special case 
of perfect feedback when the parameters are chosen as 
in Section IFT] see Remark [A. 141 

2) Noisy Partial Feedback: The desired alternative 
formulation of TZp (^N, (t|; 77, ai, a2, Bi, B2, Cp) can be 
derived along the lines shown in the previous subsec- 
tion ID II We omit the details and only present the result. 

Fix a choice of parameters 77, ai, a2, Bi, B2 and Cp = 
CpLMMSE. Denote the £-th entry of the vector a^ by 

£ and denote the row-£ column-j entry of the matrix 
B2 by b2,p,j, for j,£ e {1, . . . , ??} and e {1,2}. 
Our concatenated scheme for noisy partial feedback and 
parameters 77, ai, a2; B2, Cp = Cplmmse achieves all rate 
pairs {Ri,R2) satisfying Constraints ( 1153b on top of 
the next page, where recall that ai.o — 1, a2.o — 1^ 
po — 0, Ki^o = '*2,o = 02,1, W±fi = 0, and where 
{ai,JEi' {a2,£}fci, {piYpZh {>^iAlZh {'«2,£}fci\ 
and {Wj^.f}^'^-^ are defined by £1,0 = ^1, £2,0 = ^2, 
and Equations (I142I )-( I152I ) (Subsection IDlb except that 
( 1143b should be replaced by 



Wp.i = 62, 



3) Noisy Feedback with Receiver Side-Information: 
We derive an alternative formulation of the 
rate region achieved by our concatenated scheme 
TZsi {N, KwiWz'iVj ai, a2, Bi, B2, Csi) for a fixed choice 
of pai-ameters 77, ai, a2, Bi, B2 and Csi = Csi.lmmse- 
Denote the ^-th entry of the vector a^ by a^^i 
and denote the row-^ column-j entry of the 
matrix B^ by b,^^pj, for j,£ E {I,...,/;} and 
ly E {1,2}. The desired alternative formulation of 
7?.si (A^, Kh/jW^; 77,ai, a2, Bi, B2, Csi) can be derived 
along the lines described in Subsection ID II but with the 
following two modifications. Instead of being defined 
as in ( 11401 ), the LMMSE-estimation eiTors Ei^ and 
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i?i < - V - log 1+ ^'f, \ ' — \ ^ ^' (148a) 
iti + itQ < — > - loff IH ^ ^ — — ; ^ (148c) 



'«2,£-i"2,<'-i(l - pLi) + Var(M^j_,£_i) + N ' 
— : : : 1 : . j 

^_iai/-i(l - pI_^) + Var(Wj_,£_i) + N 



-Ki.^_iK2/-i^ai/-ia2.«-i(l - pLi) + Pi!-i(Var(Wj_.£_i) + iV) 
P£ = I ' I (152) 

^_iai.£_i(l - ) + Var(M^j_.£_i) + j,_^a2.e-i{l - p^i) + Var(Wj_,f_i) + iV 



i?. < - y - log f (153b) 
^1 + ^2 < - E 2 log Var(T4^,,_0 + ^ j ^'''''^ 



i?2,£, for £ G {1, . . . , 77}, are defined as 

^ Si - E[E,\Y',Wt\wt'] , (154a) 
i?2,, ^ S2 - E[S2|r^ W^i^-i, 1^2'"'] , (154b) 

and instead of being defined as in ( 11391 ). the innovation 
le, for £ £ {1, . . . , T]}, is defined as 

h^Ye~E[Ye\Y'-\wt\wt'] ■ (155) 
Notice that by ( 11541 ) and ( 11551 ): 

le = ai,£i?i/_i + a2,eE2,£-i + Zg, i e {1,. . 77}. 

We omit the details of the derivation and only 
state the resulting alternative formulation of the re- 
gion TZsiiN,KwiW2;V,^i,^2,Bi,B2,Csi). Our con- 
catenated scheme for noisy feedback with receiver 
side-information and parameters 77, ai, a2, Bii B2, Csi 
achieves all rate pairs (i?i,i?2) satisfying Constraints 
(11561 ) on top of the next page, where recall that a 10 = 1, 
"2,0 = 1, Po = 0, and where {ai^^j^^^ {c t2,i}l = i ^"^ 
{Pe}l=i defined through Recursions ( ll57l i-( fT59l ). 
also on top of the next page. 



E. Choice of Parameters I 

In Section lEll we present a specific choice of the 
parameters ai, a2, Bi, B2, C for given 77 S N. We treat 
the noisy-feedback setting and the noisy or perfect 
partial-feedback setting. We denote our choice for noisy 
feedback by ai, 3.2, Bi, B2, C and our choice for partial 
feedback by ai p, a2.p, 62.?, Cp. 

As we shall see, our choices are such that C and 
Cp are LMMSE-estimation matrices. Thus, the region 
achieved by our concatenated scheme for noisy feed- 
back with parameters 7;, ai, 3.2, Bi, B2, C is obtained by 
substituting the parameters into the RHSs of ( 1148b in 
Section IdTI The resulting achievable region is presented 
in Corollary lA.llI ahead. Similarly, the region achieved 
by our concatenated scheme for partial feedback with 
parameters 7;, ai p, a2,p, B2_p, Cp is obtained by substi- 
tuting the parameters into the RHSs of ( ll53al )-( fT53cb 
in Section ID2I For brevity we do not present this latter 
achievable region. 

1 ) Description of Parameters: Let a positive integer 
77 e N be given. We first consider the noisy-feedback set- 
ting; the partial-feedback setting is treated only shortly 
in Remark IA.9I at the end of this section. 

Instead of describing our choice ai, 32,61,62, and 
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1^1 



a?/ai,£-i (l - pj-i) 



1=1 



N 



N 



Rl + i?2 



< - > - bg 1+^ — ■ ^ — ■ ■ ■ 



al^a2,e-i{^ - pI_i) + N 
al^ai^e-i + a\j^a2i-i + 2aija2.ey/ai^e-ia2,e-ipe-i + N 
alja2,e-i{l - pj^i) + N 



-ai,£a2,£^ai,£-ia2,£-i(l - + Pi-iN 



^ alj,ai^i-i{l - J + N ^ al ,,a2,i-i{l - + N 



(156a) 
(156b) 
(156c) 

(157) 
(158) 
(159) 



C directly, we will describe how Inner Encoder 1 and 
Inner Encoder 2 map the fed symbols to the sequences of 
channel inputs Xi i, . . . , Xi^^i and X2.l1 ■ ■ ■ , X2.ri- This 
then determines ai, a2, Bi, B2. The matrix C is chosen 
as the LMMSE-estimation matrix. For the purpose of de- 
scribing our choice we replace the pair of input symbols 
^1 and ^2 by the independent standard Gaussians Si and 
S2. 

The inner encoders are chosen so as to produce 



^1,1 — V ^'I'^i, 

X2.I = •\/f^S2, 




-1 ^1 



-2 - 72.1 



M,^diag(l,-l,l,...,(-l)'-^), 
/3M^Var(Si-7;X)' 

/32,£ = Var(S2-7LM£V^20 , 



7i 



(fTi + (72 - 2Q(Tia2) — \e 



P2 



l2,t= ( K+a2^-2^?ala2)^l 



(160) 
(161) 



(162) 

-')^ 
(163) 

(164) 
(165) 
(166) 

(167) 



(168) 



Notice that Inner Encoder 2 modulates its inputs with 
an alternating sequence of +1 or —1 (which is inspired 
by the Fourier-MEC scheme in [111), and it multiplies 
the noisy feedback vectors by the matrix M^-i before 
further processing it (which accounts for the modulation 
of past inputs). The presented choice of the inner en- 
coders ensures that the input sequences to the original 
MAC xi,X2 H> Y satisfy the average block-power 
constraints (|4]l. In particular, with the presented choice 
all input symbols Xi^i, . . . , Xi^^i have the same expected 
power Pi, and all input symbols X2^i, ■ ■ ■ , X2^n have the 
same expected power P2. 

This encoding scheme corresponds to the following 
parameters of the concatenated scheme: 




(„1).-1 



P2 



(-1)" 



where the vectors |7i°]| ^iid {'^2"]} 
fined as the 77-dimensional vectors obtained by stacking 
the ^-dimensional column-vector 7^ ^ on top of an 
(77 — -dimensional column-vector with all zero entries, 
i.e., 





^(0) A 



-n-i 



P2 -,(0) 

/32,„-i '2,»j- 



(169) 



The parameter C is chosen as the LMMSE-estimation 
matrix Clmmse, where recall 

-1 



Clmmse - a; (A^A; + iVI^ + B,{Kw,W2 ® lr,)B; 



(170) 
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where A, = (ai as) and = (Bi B2). 

Remark A.9. A similar choice of the parameters can 
also be made in the case of partial feedback. In this 
case, we choose the parameters corresponding to the 
inner encoders and the inner decoder as in (I160l l- (ll70b 
except for replacing M62\ by 



f G{2,...,77}, 



and replacing (II68I 1 by 



72, 



= (To / 

■ N 



We denote the parameters of the concatenated scheme 
corresponding to this choice by ai p, £12. p, B2^p, and Cp. 

2) Achievable Region: We present the achievable re- 
gion corresponding to our concatenated scheme for noisy 
feedback with parameters as presented in the previous 
section. 

Definition A.IO. For a positive integer rj, define 
TZriiPiT P2, N,KwiW2) the set of all rate-pairs 
(i?i,i?2) satisfying the three rate constraints (I171I I on 
top of the next page, where recall that ai^ — 1, 

"2,0 = 1, Pifi = 1, hfi = 1, po = 0, W^fi = 0, 
where {ai.iYeZi' {'^'^•^}l=i' {Pi}l=i '"'^ defined by 
Recursions (I172l l- (ll74b also on top of the next page, and 

where Rifl = 1, ^2,0 — 1, and {ki,i}^Zi '^^'^ {^'^■,iYi=i 
are defined b^^ 



Kl.i = 1 + 



Pi \ (1 ^ pj)ai,£a2,i 



(1 - pj)aija2,£ 



(175) 



_ ^ ^ _^ ^ I ai,iCov[E2M Wi] 
■P2 I (1 - pl)ai,ia2,i 



pt^aija2,tC0M[Ei^t, We] 



(1 - p()ai^ea2.e 



(176) 



and {P.AVi' ihAVi' {Eia}Vi' {E2AV1' 
{WiY(=i> '^^'^ {l^-L/}?=i '^'"^ defined by Equations 
(I160l l-( ll68l l and by Equations ( I140l i. ( I143l l, and (I144l i. 



Corollary A.ll (Noisy Feedback). The capacity region 
of the two-user AWGN MAC with noisy feedback con- 
tains all rate regions 7?.,, (Pi, P21 -^1 ^WiW^) fo*" positive 

'''Notice that for each u \1,2} and each £ S {1, . . . , 7y — 1} we 
' p'^ I, when I is defined as in jl46t or 



have Ky i - 
in Section IdTI' 



integers rj, i.e., 

CNoisyFB (-Pi , Pj , K^Fi ) 

Del \J'}Z„{Pi,P2,N,Kw,w,) ] ■ 

\r/GN 

E Choice of Parameters II 

In Section [FT] we present a second choice of the 
parameters ai, a2, Bi, B2, and C given 77 e N. We only 
treat the noisy-feedback setting. The choice we propose 
is based on extending the choice of parameters in Sec- 
tion |ET] with a form of power allocation as suggested in 
ifm . We denote this choice by ai, a2, Bi, B2, C. 

As we shall see, for our choice C is the 
LMMSE-estimation matrix. Thus, the achievable re- 
gion of our concatenated scheme with parameters 
ry, ai, 3.2, Bi, B2, C is obtained by substituting the pa- 
rameters ai,a2, Bi, B2 into the RHSs of ( 11481 ) in Sec- 
tion ID II The resulting achievable region is presented in 
Corollary IA.13I ahead. 

7 ) Description of Parameters: We only consider the 
noisy feedback setting. An analogous choice of the 
parameters for the partial feedback setting is obtained by 
similar modifications as in Remark [A. 91 in the previous 
appendix. 

We first describe how Inner Encoder 1 and Inner 
Encoder 2 map the fed symbols to the sequences of 
channel inputs Xi.i, . . . , and X2.1, ■ ■ ■ , X2.ri- This, 
then determines ai,a2, Bi, B2. The matrix C is chosen 
as the LMMSE-estimation matrix. 

The inner encoders use the same linear strategies as in 
Section lEll with the only difference that here for every 
fed symbol, Inner Encoder 1 scales the first produced 
symbol by a constant \/r, and similai'ly Inner Encoder 2 
scales the first produced symbol by the same constant 
-y/r, where r e [0, 1] is defined as the solution to 



r2PiP2 



{rPi+N){rP2+N) 



= p*{P,,P2,N). (177) 



Equation (I177l i has a unique solution in [0, 1] because 
jim is strictly increasing in r e [0, 1] and by 



< p*iPi,P2,N) < 



P1P2 



iPi+N){P2 + N)' 



(178) 



Here, Equation (11781 ) holds by the continuity of the 
expressions in (0, and because for p = the RHS 
of (O is strictly larger than its LHS, whereas for p = 
^if^y^ the LHS of ^ is strictly larger than 



(Pi+Ar)(P2+Ar) 

its RHS. 



The reason for scaling the first produced symbols by 
y/r < 1 is to ensure that the correlation coefficient pi 
satisfies pi — ~p* {Pi, P2, N). This property is used 
in the proof of Remark IIV.8I in Section IIV-E2I where 
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Rl < 



i?2 < 



1 ^ 



1=1 



1 ' 



Var(W^i,,_i) + 7V 

7 (1 - Pi 



p 5:2 Q2,g -1 



£=1 



Var(VKi,,_i) + 7V 



Ri + R2< 



1 ' 



-1 



p 7^2 a2.e~i 

^2^2,1-1-0:^ 



0:2, £- 
1^2,1- 



(171a) 

(171b) 
-Pi-i\ 



Var(W_L,£-i) + N 



Var(Wj_,^_i) + N 



(171c) 



2^5 , 



Pi, 1-1^2.1-1 



{-lYpt-i + \lar{W^j-i) 



P2-nl,_,^il - pU) + Var(iy^,,_i) 



N 



(172) 



oi2.e = a2,/?-i „ _2 



I r> -2 OL2,l-l 
^21^'), 



2y/PiP2KlJ-lK2,e-l 



-yj PlP2Rl,l-lK2,l-l 



N 



(173) 



Pi = Pt-i 



i) + p,_i(Var(l^i,,_i) + iV) 



(174) 



we show that for perfect feedback and with the choice 
of parameters presented in this section our concatenated 
scheme achieves the sum-rate capacity. 

The trick of reducing the powers of certain channel 
inputs Xi^t and X2,t in order to control the next corre- 
lation coefficient pt was introduced in Kramer's perfect- 
feedback scheme 1. 1 1 J . Ozarow uses a different trick in 
his scheme ifTSl . He assumes that the two transmitters 
share a common randomness, which allows them to vary 
a specific correlation coefficient pt by adding a scaled 
version of the common randomness to their channel 
inputs Xi_t and X2^t- 

For the detailed description of the inner encoders we 
again replace the fed symbols f 1 , ^2 by the independent 
standard Gaussians Si and S2. Then, Inner Encoder 1 
produces 



(179) 



X 



i.i 



V 

and Inner Encoder 2 produces 

X2,i = \/r^E2, 



X. 



2J 



{-If 




£e{2,...,77}, 

where ^{Ma,ri\ {PiAVl {P2A7Zl {liA'Cl 
{I2 iYi=i are defined as in the previous appendix when 
the channel inputs Xi i and X2^i rather than being 
defined by ( 11601 ) and ( 11611 ) are now defined by ( 11791 ) 
and ( 11801 ). and where r is defined by ( I177l i. 

The described encodings correspond to the following 
parameters in the concatenated scheme: 




Pi 



B2^ 



(-1)" 



P2 -,(0) 



where denotes the all-zero column-vector and where 



{.SV _ and 



iii-ze 

f (0)1''^ 

{"^2 i\ defined as in the previous 

appendix. 

The matrix C is chosen as the LMMSE-estimation 
matrix Clmmse, where recall that 

-1 



C 



LMMSE 



= AnA,.Aj + iVI„ + B,(K 



W1W2 
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where A, = (ai as) and = (§1 §2). 
2) Achievable Region: 

Definition A.12. For each 77 e N define the rate 
region 7?.^ (Pi, P2, ^WiW2) of all rate-pairs 

(i?i,i?2) satisfying Constraints dlSll l on top of the next 
page, where now (unlike in the previous appendix) 

rP2 + N 



= rPi 
a2,i = rP2 



rPi +rP2 + N' 
rPi+N 



rPi +rP2 + N' 
Pi = -p*{Pi,P2,N), 



(182) 

(183) 
(184) 



where r is the unique solution in [0, 1] to 

= p*{PuP2,N), (185) 



(rPi + N){rP2 + N) 



and where the parameters {(^i.e}^^2' {^^■i}l=^' 

{VKl,^}^^! 0-re defined as in the previous appendix, 
if the input symbols Xi,i and X2,i rather than being 
defined by (II6OI 1 and (II6II 1 are now defined by ( fT79] l 
and (fTSOll. 



Corollary A.13. For the two-user AWGN MAC with 
noisy feedback our concatenated scheme with the param- 
eters described in Section \F1\ achieves all rate pairs in 
the regions 7?.,,(Pi, P2, N, KW1W2) for positive integers 
rj, i.e., 

CNoisyFB (Pi , P2 , KvVj ) 

2cl IJ ^„(Pi,P2,7V,Kwii 

\r,eN 

Remark A.14. Specializing the region in Definition \A.12\ 
to perfect feedback, i.e., to \^WiW2 — 0> results in the 
region TZ^ (Pi, P2, 0), which is defined as the set of 
all rate pairs (^1,^2) satisfying 

1 , / rPi 

+ E^log(l + ^M-^l,(186a) 
+ Ef log (l + ^^i^l , (186b) 



N 



N 



1 , / rPi+ rP2 



E-logfl + ^ 
^ 2?? ^ V N 



1=1 



+ 



VA7¥(-l)'-V£-i 



where the sequence {ptYlA recursively defined by 
= -p*(Pi,P2,iV) and for I £ {2,...,r/} by 



Pi-iN - {-if-^^iW2{i- pU) 



Pi(l-p2_i) + ^V^2(l-pLi 



■N 



(187) 



and where r is the unique solution in [0, 1] to ( 1185b . 

Proof: Notice that if — 0' then trivially 

W^.t = 0, for ^ e {1, 1}, and Definitions (fT65] )- 
( fT6g] l. (fT75] l. and ( fT76] l result in 



Kjy.^ = 1- 



(188) 
= (189) 
(190) 



Thus, for perfect feedback the parameters suggested 
in Section [FT] are LMMSE-estimation error parameters, 
which are optimal for perfect feedback in the sense 
discussed in Section irV-C2l The rate expressions in ( I171l i 
then result in Expressions ( 11861 ), and Recursion ( 11741 ) 
results in ( |187t . This concludes the proof of the remark. 



G. Choice of Parameters III 

In this section we consider the noisy-feedback setup 
with receiver side-information, and we present for 
each 77 e N a specific choice of the parameters 
ai, a2, Bi, B2, Csi, which we call ai, a2, Bi, B2, Csi. 
As we shall see, the matrix Csi is chosen as the 
LMMSE-estimation matrix. Thus, the achievable re- 
gion of our concatenated scheme with parameters 
77, ai, 3.2, Bi, B2, Csi is obtained by substituting the pa- 
rameters ai; 3.2, Bi, B2 into (11561 ). The resulting achiev- 
able region is presented in Corollary IA.16I ahead. 

1 ) Description of Parameters: Let a positive integer 
77 e N be given. We first describe how Inner Encoder 1 
and Inner Encoder 2 map the fed symbols to the channel 
inputs. This then determines a.i, a2, Bi, B2, C. To sim- 
plify the description we replace the symbols and ^2 
fed to the inner encoders by the independent standard 
Gaussians Si and S2. We choose the inner encoders to 
produce 



Xi^i — \/ Pi=Li, 

X2,l = \fP2^2-, 



(191) 
(192) 



and for £ e {2, ... , 7/}: 



X\^i — 



^(Si-7U,y/-i), 



^2,t = (-1) 



-1 



/^2,<'-l 



(186c) 



(193) 

S2-7v-iM£-iKf"^), 
(194) 
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27/ ° V ^ 



277^ Var(T4^i,,_i) + AT 



(181c) 



where for ^ G {1, . . . , 77 — 1} the matrix is defined 
as in ( 11641 ) and 



/3i,, ^Var(Si~7;X' 



/32,^^Var(S2-72,£ 



1} ' 



(195) 
(196) 
(197) 

(198) 



Notice that this choice implies that the ^-th channel input 
produced by Inner Encoder 1 is a scaled version of 
the LMMSE-estimation error of Si based on the past 
feedback outputs Vi 1, . . . , Vi.f_i. Similarly, for Inner 
Encoder 2. 

The described encodings correspond to the following 
parameters of the concatenated scheme: 



ai = 

A 

a2 = 
and 

Bi^ fo 
B2^(0 



\lf- 



/7¥ 



7 1,1,-1 



where the vectors |7i'^]| and |'y2"£j" ^i"^ de- 
fined as the 77-dimensional vector obtained by stacking 
the ^-dimensional column-vector 7^^^ on top of an 
(77 — -dimensional column-vector with all zero entries, 
i.e., 



r,-l 



{1,...,77-1}, z.e{i,2}. 



The matrix Csi is chosen as the LMMSE-estimation 
matrix with side-information, i.e., 

Csi = Aj(A,.Aj + 7VI^)-\ 

where Aj- ^ (ai 32). 



2} Achievable Region: 

Definition A.15. For each 7/ G N define the region 
'Rr^{Pi, P2, N ,KwiWq,) '^^ tf^^ of all rate pairs 
(i?i,i?2) satisfying 



Pi 



n 



1=1 
Ri + R2 
1 







N 




P2 


012.1-1 




pI-i) 






N 




Pi 


ai,e-i 


+ P2 


a2,e-i 



2r] 



N 



2VpJ^, 



I 0'l,i-ia2,t-l 
0i,t-i$2,e-i 



(i + (-i)^-V.-i)' 



N 



where aifl — 1, 02,0 = 1. Po = 0, and {cti.i}^^i, 
{(^2,iy^^i, o.nd {peYl^i are recursively given by Recur- 
sions ( I199l l-( I201I) displayed on top of the next page, and 
where /3i,o = l,/3 2.o = 1, and {l3i,iYtZl and 02,e}eZi 
are described by ( ll91b -( fT98b . 

Corollary A.16. The capacity region 
CNoisyFBSi(-Pi, -Pz, KvKiiy2) of the two-user Gaussian 
MAC with noisy feedback and receiver side-information 
contains the rate regions 7?,,,(Pi, P2, KiyjVF2) 
positive integers rj, i.e., 

CNoisyFBSI (-Pi , P2, N,KwiW2) 

Del IJ n^{Pi,P2,N,Kw,W2) 

H. Rate-Splitting with Carleial's Cover-Leung Scheme 

In this section we describe the rate-spUtting scheme in 
Section IIV-D2I in more detail. We consider the version 
of the scheme where after each Block b <E {1, . . . , B} 
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ai 



ai 



0L2X = 0.2,1-1 



Pl- 



2/m(l + (-l) 



"1 / Ql.<-lQ2,g-l 
^) V /3i,f_i/32.f-i 



"2,t-l 



P2{i-pU) 



N 



"l,f-lQ:2,«-l 



'1,«-1P2,<-1 



/5l.*-1^2,«-l 



(l-pti) + p,_iA^ 



(199) 



(200) 



(201) 



Transmitter 1 first decodes Message M2,cs,6 before 
decoding Ajf2,CL,fc- Similarly, for Transmitter 2. 

We first describe the encodings. We start with the 
encodings in Block h, for a fixed G {1, . . . , i?}, where 
we assume that from decoding steps in the previous 
block (6—1) both transmitters are cognizant of the 
pair (Mi^cL,6-i,M2,CL,6-i)- Given M^^cL.b = m^,CL,b, 

Mi,CL,b-l "ll,CL,6-l, and Af2,CL,6-l = ™2,CL,6-1, 

Transmitter i', for E {li2}, picks the 

codewords U^Mim^fiL^b) — ■ • • , "iy,6,jjn), 

Wi^6(mi,cL,fc-i) = . . . ,i:ji^6,,,„), and 

i^2,&('7i2,CL,fc-i) = (^2,6,1, . . . ,a;2,fc,^„) from the 
corresponding codebooks, which have independently 
been generated by randomly drawing each entry 
according to an IID zero-mean unit-variance 
Gaussian distributior0- Fix correlation coefficients 
Piip2 G [Oj 1]' which are constant over all blocks 
b G {1,...B}. Transmitter h' computes the following 
linear combinations for k £ {1, . . . ,n} and ly E {1, 2}: 



V(l - pl)P[,n,.,b,k + y -plPl {u;ub,k + u^2Ak) , (202) 
where 

Ui/,b,fc — (,M,y,fc^(fc-l),,+ l, • • ■ , Ml/,b,fe»7) , 

^v,b,k — l'^iy,6,(fc-l)?)+li ■ • ■ i^v.b,kri) ■ 

Moreover, Transmitter v uses our concatenated code to 
encode Message A/i, cs.fc- Specifically, given iV/,y.cs,b ~ 
nT-ufis.b, Transmitter feeds m^,c5,b to Outer En- 
coder V, which picks the codeword ^^(mjxcs.h) = 
{S.u,bs, ■ ■ ■,£.v,b,nY corresponding to m^,cs,6 and feeds 
it to Inner Encoder v. Denoting the parameters of Inner 
Encoder v by a^, and B^, Inner Encoder v produces the 
ry-dimensional vectors 

s^u£,u,b,k + ^u^u,b,k, fc e {/c, . . . (203) 
where 

,(fc-l)jjn+(fe-l)))+l 1 ■ ■ ■ 1 ^i/,(f>-l)»)n+'f)) ■ 

'■*To satisfy the power constraints the Gaussian distribution should 
be of variance slightly less than 1 . However, this is a technicality which 
we ignore. 



The signal transmitted by Transmitter v is then de- 
scribed by the sum of the vectors in ( 1202b and ( 12031 ) as 
follows. For k E {1, . . . , n} and v E {1,2} 

^v,bM = v/(l - Pl)PlvLv,b,k 

+ \j\plPl {.^l,b.k + '^2,b,fe) 

+a^f^,6,fc + B^V^,;,^fc, (204) 

where 

X^_b,fe ~ {Xj^ (}:,_l-^T^n+(k-l)r)+lT--i^v,{b-l)r]n+kr]Y- 

Notice that if ai , a2 , Bi , and B2 satisfy the power con- 
straints ( fT9b for powers (Pi — P[) and (P2 ^ P2)^ noise 
variance [N + P[ + P2 + 2^ P[P!^pip2), and feedback- 
noise covariance matrix \iw1W2 and if the outer code's 
codewords {Hi(Afi,cs,6)} and {H2(M2,cs,h)} are zero- 
mean and average block-power constrained to 1, then 
the channel input sequences satisfy the power constraints 
with arbitrary high probability. 

In Block (B + 1) the two transmitters only send 
information about the pair (A/i.cl,s, -M2,cl,b)- Given 
A^i,CL,s = ™i,CL,s and A/2,cl,b = TO2,cl,b, both 
transmitters pick the codewords ijJi^B+iinii.cu^) — 
(wi,B+i,i, . . . ,a;i,B+i,J7n)"^ and uJ2,B+i{m2.cu^) = 
(w2,B+i,i, • ■ • ,W2,B+i,J7n)"^ from the corresponding 
codebooks and form a linear combination of power P^. 
Thus, defining 

^1^,5+1 = (X,^,Br)n+l, ■ ■ ■ , ^ u.iB+ljrjnY i 
<^v,B+l — {^v,B + l,l, ■ ■ ■ , ^iy,B + l,riny , 

the signal transmitted by Transmitter ly can be described 

as 



X,,B+i = ^ -plPl (a;i,B+i + a;2,B+i) . (205) 

Next, we describe the decodings. We start with the 
decoding at Transmitter 2; the decoding at Transmitter 1 
is performed similarly and therefore omitted; and the 
decodings at the receiver are described later on. 

Recall that after a fixed block &, for 6 e {1, . . . , B}, 
Transmitter 2 first decodes Message Afi.cs,6, followed 
by Message A^i cl,6- After Block 6, Transmitter 2 
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observed {V2,b,i, . . . , V2,6.„}, and additionally is 
cognizant of the realizations of {U2,6.i, . . . , U2,6.n}, 

{^l,b,l, ■ ■ ■ ,^l,b,n}, {^2,b,l, ■ ■ ■ ,^2,b,n}, and 

{S2,6,i, . . . , S2,6,n}. It can thus compute for 
fc e {l,...,n}: 



V2,fc,fc = (I - (Bi + B2))Y2Ak - - pI)P2'U2. 



b,k 



\pIP'i + sj \piP2 I {^lAk + ^2,bM) 



ai • ^i,b,k + V (1 - pl)P[1Ji,b.k + Z 



b,k 



where 

Z6,fe = (■Z'(b_i)^„+(fe-l)ri+l, • • • , ^(b-l)?)n+fcn)^: 
W^_b^fe = (VF,^,(fc-l),,„+(fe-l)„+l, . 



zn ) • 



I W^t/,(6-l)r;n+fc 

Since the sequence | V2,{,.i, . . . , V2.h,„| is independent 
of the additional information {U2,6.i, . . . , U2,6.n}, 

• ■ • , f^l,6,n}, {^^2,fc,l, • ■ • , ^^2,fc,n}, and 

{S2,b,i, . . . , S2,6,n}, Transmitter 2 can optimally decode 
Message Afixs,fc based on |v2,fca, . . . , V2,6,„| only. 
To this end, it does not apply the inner and outer decoder 
of the concatenated scheme, but directly applies an 
optimal decoder for a Gaussian single-input antenna/yy- 
output antenna channel with temporally-white noise 
sequences which are correlated across antennas. Let 
denote Transmitter 2's guess of Message Afi cs 



(Tx2) 
1,CS 



and let ^sj^^^^-*, . . . , sj^^^]^ be the coiTesponding 
codeword of the outer code. 

Transmitter 2 then decodes Message Afi cL.b as fol- 
lows. It first attempts to subtract the influence of the 
sequence produced by encoding A/i.cs.fc and to this end 
computes 



^2,b,k - ^2.b,k - ^l^lfi^k ' 



k e {l,...,n}, 



which, if Transmitter 2 successfully decoded Afi_cs,fc, 
equals 



+ Bi(Wi^b,fe-W2,M), fcG {!,...,«}. 

Transmitter 2 then decodes Message Afi cL,fc based on 

{" (2) (2) 1 

V2 ^ ^ , . . . , V2 ^ „ > using an optimal 

decoder for a Gaussian ?7-input antenna/ry-output antenna 
channel with temporally-white noise sequences corre- 
lated across antennas. 

As a last element, we describe the decodings at the 
receiver After each block b € {1, . . . , B} the receiver 
performs two decoding steps. In the first step it de- 
codes Messages (Afi,cs,fc, Af2,cs,6) while treating the 
sequences produced to encode Afi_cL,b-i, Af2,CL,6-2, 



A/i.cL,b, and A/2.cl,6 as additional noise. For this de- 
coding step the receiver uses inner and outer decoders of 
the concatenated scheme. Let ^Afi cs,6, Af2,cs,h^ denote 
the receiver's guess of the pair (Afi cs.h, Af2,cs,b) pro- 
duced in this first step, and let ^S^'^^'!^ . . . , S^*^^^^ and 



^2 b 1^ ■ ■ ■ ' ^2 b n I corresponding codewords of 

the outer code. 

In the second decoding step, the receiver decodes 
Messages A/i,cL.h-i and Af2,CL,fc-i- To this end, it 
first pre-processes the outputs observed in blocks b 
and 6 — 1 to mitigate the influence of the sequences 
produced to encode Messages (A/i.cs,6, Af2,cs,b)- The 
outputs in block b are processed as follows: For each 
fee {1, . . . ,n} the receiver computes 

I 6,fc - I 6,fc - ai'=i,h,fc - a2^2,6,fe 

-BiYfc^fe - B^Yb^k, (206) 

where 

Y'b,k = (Yi^b-l)rin+{k-l)ri+li ■ ■ ■ i ^(6-l)77n+fe»j)^! 

Notice that in case the first decoding step was successful. 



i.e, in case that ^ 



(Rx) 
l,b,k 



^i,6,fc and ^^^f^ = ^2,b,k holds 



for all k E {1, . . . , n}, ( I206l l corresponds to 



(l-p2)p^'Ui,6,, + J(l-pi)P^U 




J2,b.k 



\pIP^ + J \plP2 I {^l,bM + ^2^,k) 



+ B1W1, 



b.k 



B2W2.b,fc + Zb,fc. 



Before describing how the receiver processes the out- 
puts in block 6—1, we notice that the receiver already de- 
coded Messages A/^i,cl,6-2, Af2,CL,b-2, Afi.cs.fc-i, and 
Af2,cs,6-i in previous decoding steps. Let A^i cl&-2' 

^■^fct&-2' ^■^fcl&-i' and M^^cib-i denote flie re- 
ceiver's guess of these messages. Also, for each k € 

- (R") - (Rx) 

{!,...,«} let ^i^b-i,k and ^2,b-i,k denote the code- 
words that in the codebooks used in the /c-th sub- 
block of block 6—1 correspond to the guesses 

ie;:} M?^^ and let (s^^^ ^^^^ ' ' 



■ ' "l,h-l,ji 



l,CL,b-2' ^"2,CL,fc-2' 

and (^^^^^_^ . . . ^'e!"^^^_^ denote the codewords 
that in the outer code used in block 6—1 correspond 
to the guesses A"/-['^g j^ -^, and M^clb-v '^^^ receiver 
processes the outputs observed in the block (6 — 1) by 
computing for fc € {1, . . . , n}: 




pIp[ 



P2P2 I ( ^l.b-l,k + J^2,b-l,/c 



2'''^ ' ■ V 2 

— aiSi_fc_i_fe — a2S2,fc-i,fe — BiYfe^fc — B2Yb_fe 



(1 - pI)P^V2m-i^ 
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+ BiWi,h_i,fe + B2W2,6_l,fc + Zfc_i,fe. 

Equipped with the sequences | (^Y^ i, Y^^^j^ | 
the receiver finally decodes Messages 
(Afi,cL,b-i,M2,cL,b-i) using an optimal decoder 
for a 2r7-input antenna/277-output antenna Gaussian 
MAC with temporally-white noise that is correlated 
across antennas. 

After Block {B + 1) the receiver decodes Mes- 

('^) ~ (2,) 

sages (Mi,cL,B,M2,CL,s) based on Y^"\, . . . , Y^^„ 
and based on the sequence (Yerfn+i, • • • , Yi^B+i)r)n)- To 
this end, it again uses an optimal decoder for a 2?;- 
input antenna/277-output antenna Gaussian MAC with 
temporally-white noise that is correlated across antennas. 

7 ) Noisy and Perfect Partial Feedback: The proposed 
extension applies also to settings with noisy or perfect 
partial feedback to Transmitter 2, if Bi is set to the all- 
zero matrix and if Carleial's scheme for partial feedback 
is applied. Thus, our scheme should be modified so that 
there are no decodings taking place at T ransmit ter 1 and 
so that in ( 1204b and ( 12051 ) the term ^ ^plPl{ijJi^b^^ + 

<^2,6,i) is replaced by y/ plP;,uJi^b,i- 

Notice that in a setting with perfect partial feedback 
to Transmitter 2 the components of the noise vec- 
tors corrupting {V2,b.i} uncorrelated, similarly for 

{(Vg,, - - P?^i')ui,6-i,^)} and for Yb^ and 
~ (2) 

Yf, / . Thus, optimal decoders for Gaussian multi-input 
antenna/multi-output antenna channels with uncorrelated 
white noise sequences can be used to decode A/i.cL.b 
at Transmitter 2 and to decode {Mi.CL.b, M2.cL,b) at 
the receiver. Moreover, the observation {Yb.i} at the 
receiver is a degraded version of the observation {Vi b i} 
at Transmitter 2. Thus, since the receiver decodes 
{Mi^cs,b,M2.cs.b) based on {Yb.i}, in settings with 
perfect partial feedback there is no loss in optimality in 
the presented rate-splitting scheme if based on {Vi_fc,i} 
Transmitter 2 first decodes message Mi_cs,fc before de- 
coding il/i_cL,fc- In particular, the set of achievable rates 
of the concatenated scheme is solely constrained by the 
decoding at the receiver. 

/. Interleaving and Rate-Splitting with Carleial 's Cover- 
Leung Scheme 

We describe the scheme in Section IIV-D3I in more 
detail. We start with the encodings and first consider the 
encodings in the £-th subblock of Block h, for a fixed h G 
{l,...,B} andee Define 6 = {b-l)r] + i. 

We assume that from decoding steps after previous 
subblocks ((6— 2)?7+l), . . . , (6—1), both transmitters are 
cognizant of {(Mi^icL,(fc-2),,+i, ^^2,iCL,(fc-2)r,+i), 

(^l,ICL,S-P^2.ICL,fc-l)}- 

The encodings in Subblock b consist of four steps. In 
the first step Transmitter 1 produces an n-length vector to 
encode messages Af^ i^L.fc' ^^i,iCLi-„' and A/2,icLi-„ 



as follows. Given Af 



l.ICL.h ~ "^l.ICL.i)' -^^l,ICL,6-j; ~ 

"^i.iCL.b-r,' and Af2 jcLi-r, = "^2,iCL,6^r,' Transmitter 1 
first picks codewords u^^(Af^_jcL,6)' '^i,h(^^ijCL,fc-„)' 
and <^2 b(-^2 iCL 6-))) froi^ the corresponding code- 
books, which have independently been generated by ran- 
domly drawing each entry according to an IID zero-mean 
unit-variance Gaussian distributiorl]3 Transmitter 1 then 
completes the first step by computing the following 
linear combination 



(i-p?)^i'ui,; 



1 



2,b i ' 



(207) 



where pi £ [0, 1] is a fixed chosen parameter of the 
scheme, which does not depend on b. Similarly, for 
Transmitter 2. 

In the second step. Transmitter 1 
computes the "cleaned" feedback vectors 
V^.(b-i)>,+i,---,V^,(b-i)i,+<!-i, where V^^, for 
b' e {{b - l)ri + 1, . . . , {b - l)rj + e ~ 1} is defined as: 



V 



l.b' 




where ^, ^ (^.,(b'-i)n+i- • ■ > KmuY- Similarly, for 
Transmitter 2. Notice that for b' e {(6-1)77+1, . . . , (6- 
1)?7 + £ — 1} the "cleaned" feedback vectors satisfy 



V 



l,b' 



w 



l,b' 



V 



2,b' 



w 



2,b'' 



1} and 



where for b' £ {{b — 1)77, . . . , (6 — 1)?7 + 
j.e{l,2}: 

^.,b' = iW^,ii'-l)n+l^---^^^:b'ny- 

Thus, they correspond to the feedback vectors of a 
"cleaned" channel where the channel outputs are de- 
scribed by the vectors | (V^ y — Wj^ ) | ■ 

In the third step. Transmitter 1 produces an n-length 
vector to encode Message A/ucs.b using the "cleaned" 
feedback vectors in (12081 ) as explained shortly. Assume 
that at the beginning of Block b Transmitter 1 fed 
Message Afi ics,6 to its outer encoder and that the outer 
encoder produced the codeword ^i^- Let 

^1 — (ai,i, . . . , ai,r^y , 

/6i,i,i ... 6i,i,iA 



Bi^ 



bl.rj.rjj 



"To satisfy the power constraints the Gaussian distribution should 
be of variance slightly less than 1 . However, this is a technicality which 
we ignore. 



45 



denote the parameters of Transmitter 1 's modified inner 
encoder. The modified inner encoder then produces the 
n-length vector 

which is also the n-length vector that Transmitter 1 
produces in this third step. Similarly, for Transmitter 2. 

In the forth and last step. Transmitter 1 sums the n- 
length vectors in ( |207t and ( |209l l, and sends the resulting 
symbols over the channel. Similarly, for Transmitter 2. 

Thus, the signal transmitted by Transmitter v in Sub- 
block h can be described as follows: 

= v/(l - Pl)P>.,i + \j\plPl {^,.1 + 
J = l 

where X^j, ^ • ' • ' ^i^i")'- 

Notice that if the parameters (ai, a2, Bi, B2) satisfy 
the power constraints (fT9] l for transmit powers (Pi — P[) 
and (P2 — ^2)' noise variance N, and feedback-noise 
covariance matrix \^WiW2^ then the input sequences 
satisfy the power constraints dU with arbitrary high 
probability. 

We next consider the encodings in the last Block {B + 
1), where the two transmitters send information about the 
pairs of messages {(Mi_cl,(b-i),,+i, A^2.CL,(B-i)r,+i), 
• (Mi,CL,Br,,M2,cL,B>,)}- We considcr a fixed sub- 
block h e {Brj + !,...,(_£? + 1)77}. The transmit- 
ters send their channel inputs in this last block {B + 
1) as follows. Given ^ ,^ = m-^ and 

■^2 CL b-r; ^ "^2 CL 6-J7' ^^'-^ transmitters choose the 
codewords t^i^lA^i^cL.b- J' and '^2,b(^2,CL,b-r,) fro™ 
the corresponding codebooks and send a linear combi- 
nation of the chosen codewords over the channel. Thus, 
the signal transmitted by Transmitter in Subblock b 
can be described as 

^.:i>-\llpin{^i,i + ^2,b)^ (211) 

where 

We next describe the decoding at Transmitter 2; the 
decoding at Transmitter 1 is performed similarly and 
therefore omitted; and the decoding at the receiver will 
be described later on. 

After each subblock b e {1, . . . , Br/} Transmitter 2 
decodes Message Afj^ j^^^ j^. We consider a fixed Sub- 
block b e {l,...,Br]} and define b e {l,...,B} 
and £ e {!,..., 77} so that b ^ {b - 1)t] + £. 
Before describing the decoding of Message f, 
at the end of this paragraph, we notice the fol- 
lowing. After Subblock b. Transmitter 2 observed 



the feedback vectors Y2,{b-i)r,+i, ■ ■ ■ ,^2,ib-i)r,+e 
and is additionally cognizant of Messages Af2,ics,6, 
{^2,iCL,(fc-i)»7+i. • • • > A/2jcL,(h-i)r,+£}. and (assum- 
ing its previous decoding steps were successful) 
of Messages {Mi_icL,(b-i)^+i, ■ • • , Ai^i,iCL,(fc-i)r,+f-i}- 
It can therefore reconstruct the sequences pro- 
duced to encode these messages. Moreover, Transmit- 
ter 2 can estimate Transmitter I's feedback outputs 
Vi. (6-1)^+1, ... ,Vi,(b_i)^+f, (even though it cannot 
reconstruct them because it is incognizant of the feed- 
back noises). By subtracting the reconstructed sequences 
and the estimated sequence from its feedback outputs 
Transmitter 2 can thus compute the n-dimensional vec- 
tors N2^(b_i),,+i, . . . , N2_(fc_i),,+£_i and V2,(b-i),,+^, 
which are defined as: 

^2,(6-1),,+^ 

- ^2,{b-i)n+e - \/0~'f^)Pl'^2,{b-i)v+e 
i=i 

= - Pi)Pi'^iXb-i)r,+e + ai,£3i,6 

+ Z(6-l),,+£ + W2^(f,_i),,+^, 

where where we define the vector Z(f,_i),,+^ = 

(■^((f)-l)r)+f-l)n+l7 • • ■ , ^((f)-l)r)+f)ri)^; ^nd for b' = 

{b -!)+£' and f e {1, 1}: 
^2M - ^2.b' •^(l-p?)A'Ui,B< 
-^{^-pDP2^2,b' 

- + ^^^-i' + ^2,6') 
I'-i 

- ^ (bl/'J + b2,e'j)^2,(b-l)r,+j 

- a2,^'H2,6 

e'-i 

+ ^^'^''3 (Wl,(6-l),,+j - W2,(fc_.i)^+j) 

i=i 

+ ^b'+^2.bn 

where Z^, = (^(b,_i)„+i, ■ • • , Transmitter 2 

finally decodes Message AI-^ based on N2,(6-i)j)+ii 

■ ■ ■ ,'^2,{b~i}n+e-i, and Y2,{b-i}n+i using an optimal 
decoder for a single-input antenna/multi-output antenna 
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Gaussian channel with correlated but temporally-white 

noise sequences. 

We next describe the decoding at the receiver. We first 
consider the decoding of the pair (-^i cl 6' -^2 cl &) 
after a fixed subblock b G {rj + 1, . . . , {B + l)ri}. 
Define b € {2, . . . , B + 1} and £ G {1, . . . , 77} so that 
b = {b — 1)77 + £. Before describing the decoding of 
the pair (Af-^ ^^^^ j^, b) the end of this paragraph, 

we notice the following. In decoding steps after 
previous subblocks the receiver has already decoded 

Messages {(MijcL,(6-3)r,+<", Af2,ICL,(6-3)r;+£')}|' = l' 
{(-^l,ICL,(fc-2)jj+£', ^2,ICL,(6-2)J7+^')}|' = 1' ^ud 

{(-^i,iCL,(fc-i)»j+<?'> ^2,iCL,(6-i)»,+^')}l=\- Therefore, 
(assuming that these decodings were successful) the 
receiver can reconstruct the sequences produced to 
encode these messages and subtract them from the 
output signal. Thus, the receiver can compute for 
b' € {b- 1, b} and e G {!,...,£- 1} the "cleaned" 
output vector 




e'-i 
3=1 

+2(6'-!),,+^', 

where 

Y(6'-l),,+^' — (y((5'_i),,+^'_i)„+i, . . . , 5^((6'-l),,+^')nr, 

and it can compute 

■V(2) 

I (b-2)r,+e 

- ^ib-2)n+e 

■{^l,{b-2)ri+e + ^2,{b-2)ri+e) 

= v/(l - />nP[Uub-2)r,+e 

+ \J (1 - P2)P2^2,(b-2)r,+i + ai,^Sl,6 + 02,^32,6 

i-l 

+ ^{Kt,3^l,(b-'i)v+3 + ^2,«,jV2,(6_2),,+j) 
+ 2(6-2)77+^1 

where Y(f,_2)n+i = 

{Y{{b-2)r,+i-V,n+l, ■ ■ ■ ■,Y{{b-2)r,+C)ny ■ NoticC that 



the "cleaned" output vector Y(f,/_i)^_|_£/ equals 
the difference iy i.(b'-i)r^+t' -^i.,(b' -1)^+1') ■ 
Notice further, that even though the "cleaned" 
outputs Y(6_2)^+i, . . . , Y(b_2)„+^_i and 

Y(h-i)^+i,...,Y(f,_i)^+^_i do not depend on 
the pair (-^i cl S' -^2 cl s)' '■^^y correlated 

' ' ' ' ~ (2) 

with the noise sequences corrupting Y|^_2),,+i: ™^ 
Y(6-i),,+£ and should be taken into account by the 
receiver when decoding (-^i cl 6' ^2 cl ;>)■ Thus, the 
receiver should decode the pair (-^^ cl S' -^2 cl &) 
based on the vectors Y((,_2)„+i, . . . , Y(6_2)r7+£-i, 

— — — (2) 

Y(b_i)^+i, . . . , Y(b_i)^+£_i, Y(^_2)r,+r ™^ 
Y((,_i)^_i_£. To this end, the receiver first partly 
"decorrelates" the vectors by computing 

Y(b-l)r,+£ 

£-1 

- Y(6_i)^+£ - ^{^1^3 + ^2,«j)Y(6_i)^+j-, 

i=i 

= - pi)P[^ub-i)v+i 

+ ^ (1 - pl)P!,\52,ib-l)r,+t 

■(^l,(6-l)r;+^ + ^2,{b-l)rj+t) 

-|-ai,£Hi,6 + a2,^S2,6 

+ ^{^^,i,3^i,(b-l)'n+i + ^^2,<!jW2,(6_i)„+j) 

+Z(fe-i),,+£, 

V(2) 

* {b-2)r,+l 

e-1 

- ^(6-2),,+^ - '^(b-^Aj + b2,e,j)'y{b-2)n+j 

= \/(l-P?)A'Ul,(6-2),,+£ 
+ ^(l-pi)P^U2,(6_2)„+^ 

+ 2(6-2)77+^7 

and for b' G {6-1,6}, f G {1,...,^- 1}: 

' (6'-l)r7+^' 
- Y(6'_i)^+£' 

e'-i 

- ^ ibi,i',j + 62,r,j)Y(6'_i)^+j 
= ai,^'3i,6' + a2,e'^2,b' 
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I'-l 

i=i 

+Z(b'-i),,+f'. 

The receiver then decodes the pair of 
messages (-^i icl fi' -^^2 icl b) based on 



V(3) 

^ (b-2)j)+l' • 
V(3) 

^ (f)-l)j)+l' • 



r(3) 
(&-2)r,+£ 



-1' ^(6- 



(6-2)r,+£ 



and 



''Y(6li)„+^_i,Y(6_i)^+^ using an 
optimal decoder for a 2-input/2£-output antenna 
Gaussian MAC with temporally-white noise sequences 
correlated across antennas. 



After decoding Messages {(^^i jcl b' -^2 icl b)};,-i 
the receiver decodes Messages 

{(A^i,ics,fc,M2,ics,h)}f=i- To this end, it first reverses 
the interleaving introduced by the modified inner 
encoders on the "cleaned" output vectors Yi, . . . , Y^^. 
That is, for h E {1,...,B}, it constructs the rjn- 
dimensional vector 



Delnt.fc 



6-i)))+iai ■ 



bri.lj 



^(b-l)r(+l,2i ■ ■ ■ ^Yf 



Y, 



{b—l)rj.n 1 



fci),2, 
1 Yb^f^n) : 



where ■ denotes the i-th entry of vector Yg. It then 
decodes Messages (Mijcs.b, Af2,ics,6) applying inner 
and outer decoder of the concatenated scheme to the 

vector Yoelnt.b- 

1 ) Noisy and Perfect Partial Feedback: The proposed 
extension can also be applied in settings with noisy 
or perfect partial feedback, if Bi is set to the all-zero 
matrix and if Carleial's scheme for noisy or perfect 
partial feedback is applied. Accordingly, our scheme 
should be modified so that there is no decoding taking 
place at Transmitter 1. Therefore, in ( 12101 ) and ( 121 lb 
the term ^ ^plPl{u}^ b + '^2 b) should be replaced by 

y^u;, ^, forz.e{L2}. 

Notice that — as in the second extension — for perfect 
partial feedback the various vectors computed for the 
decodings at Transmitter 2 and for the decodings at the 
receiver have uncorrected noise components. Therefore, 
without loss in optimality. Transmitter 2 and the re- 
ceiver can use optimal decoders for Gaussian multi-input 
antenna/multi-output antenna channels with independent 
white noise sequences. 
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